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Abstract 

The  complex  multifaceted  decision  situations  present  today  suggest 
the  need  for  a  timely,  automated  too.  A  decision-maker  is  forced  into 
comparing  alternative  actions  or  systems  over  an  entire  set  of  different 
measures  of  merits  Vhis  effort  is  an  on-line,  real-time,  computer-based 
decision  aid  designed  to  assist  the  decision-maker  in  clarifying  orefer- 
ences  in  a  complex  decision  environment.  It  is  applicable  to  problems 
which  may  be  represented  by  a  hierarchy  of  objectives  to  be  satisfied. 

The  program  is  MADAM:  Multiple-Attribute  Decision  Analysis  Model,  and  it 
is  written  in  FORTRAN  V  and  is  implemented  on  the  CYBER  175  system.  MADAM 
is  designed  to  aid  the  decision-maker  as  he  or  she  progresses  through  prob¬ 
lem  formulation,  parameterization,  sensitvity  analyses,  and  a  decision, 
including  storage  of  all  data  and  rationales,.  Deterministic  problems  are 
analyzed  through  Multi -Attribute  Utility  Theory  concepts  and  an  additive 
value  function  is  utilized  for  sensitivity  analysis.^ Pairwise  preferential 
independence  is  tested  between  attributes.  The  sensitivity  analyses  in- 
elude  a  cumulative  weight  analysis,  a  relative  weight  analysis,  and  an 
attribute  level  analysis.  Th.e.  analyses  may  be  conducted  by  fixing  an  ob¬ 
jective  to  be  considered  and  conducting  the  analysis  across  the  alternative 
systems  or  actions,  or  conversely  by  fixing  the  alternative  to  be  consid- 
ered  ancl  conducting  the  analysis  across  a  desired  set  of  objectives-, 

yThe  work  is  divided  into  two  volumes.  Volume  I  is  a  theoretical  pre^- 
sentation  and  includes  a  user's  manual.  It  requires  no  programming  ex¬ 
pertise  and  may  be  used  independently  of’ Volume  II.  Volume1  II  is  a  pro-, 
gramming  manual  inducing  the  source  code.^It  may  not  be  used  independently 
of  Volume  I. 
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MADAM:  Multiple-Attribute  Decision  Analysis  Model 

I.  Introduction 

The  process  of  decision-making  in  the  context  of  complex  problems  is 
an  arduous  task  at  best.  Complex  problems,  especially  in  societal  en¬ 
vironments,  are  compounded  by  "spill-over"  effects  which  impede  the  es¬ 
tablishment  of  sharp  problem  boundaries.  As  a  result,  a  critical  part 
of  decision-making  is  defining  boundaries  of  the  problem  (Keeney  and 
Raiffa.,  1976).  Unfortunately,  an  all  too  common  occurrence  in  complex 
decision-making  is  a  gross  imbalance  between  the  amount  of  effort  ex¬ 
pended  in  developing,  modifying,  and  verifying  an  elaborate  model,  and 
the  actual  choosing  of  an  alternative  solution  (Keeney  and  Raiffa,  1976). 
Often  the  elaborate  output  of  several  measures  of  merit  resulting  from 
the  alternative  solutions  is  compressed  into  a  few  graphs  or  tables  to 
be  included  in  a  summary  report  to  the  decision-maker*  (DM).  This  situ¬ 
ation  brings  severe  criticism  to  bear  oh  the  notion  that  the  DM  attempts 
to  make  fully  informed,  rational  decisions. 

A  complete  amelioration  of  ill-informed  or  irrational  decision-mak¬ 
ing  is  not  possible,  however,  by  simply  inundating  the  DM  with  relevant 
data,  the  introduction  of  the  computer  has  had  a  profound  impact  upon 
this  latter  point,  and  early  computer-based  decision  aiding  systems  were 

*The  term  decision-maker  is  used  generically  tc  refer  that  person  (or 
group  of  .people)  who  is  responsible  for  making  and/or  administering  the- 
decision. 


primarily  designed  to  augment  the  DM ’ s  ability  to  collect,,  display,  store, 
and  retrieve  information,  .psychologists  are  currently  in  a  position,  to 
persuasively  argue  that  this  is  not  an  adequate  approach  to  a  computer¬ 
ized  decision  support  aid.  These  tools  are  misdirected  in  that  human 
DM's  are  intrinsically  slow  information  processors,  and  thus  they  are  un¬ 
able  to  utilize  most  of  the  "available11  information  (Fischer  et  al  1978). 
Thus  it  is  important  to  recognize  the  shift  in  decision-aiding  cechnolo- 

j 

gies  to  enhance  the  information  processing  function.  A  significant  em¬ 
phasis  has  been  made  to  aid  the  DM  in  breaking  down  a  complex  problem  in¬ 
to  a  system  of  subproblems  which  represent  the  origina1  problem,  but  which 
may  be.  considered  separately.  It  is  generally  accepted  that  people  are 
more  consistent  when  faced  with  simple  judgments  than  they  are  at  aggre¬ 
gating  large  amounts  of  information  to  form  an  overall  decision  (Fischer 
et  al ,  1978).  Decision  analysis  does  not  provide,  and  is  not  intended  to 
provide,  a  comprehensive  calculus  of  the  human  psyche.  The  crux  of  its 
development  is  to  provide  a  DM  with  a  tool  which  will  facilitate  rational, 
consistent  decision-making  and  provide  a  medium  for  concise  communication 
and  data  processing. 

This  study  is  an  effort  to  expand  an  existing  decision  aid  which 
utilizes  the  theoretical  underpinnings  of  Mul ti -Attribute  Utility  Theory 
(MAUT)  to  aid  the  DM  in  the  resolution  of  very  complex  decisions.  This 
decision  aid  is  the  extension  of  the  tools  developed  by  Morlan  (1979) 
and  Lee  (1981).  The  expansion  involves  improved  processing  of  informal 
tion  received  from  the  DM,  and  the  extension  of  the  sensitivity  analysis 
to  include  a  system  analysis  over  a  set  of  objectives  or  attributes..  An 
emphasis  is  made  to  address  the  issue  of  problem  formulation,  which  in¬ 
cludes  the  formation  of  an  objective  hierarchy  and  the  establishment  of 
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a  set  of  attributes  capable  of  measuring  achievement  of  the  objectives. 
Background 


This  discussion  centers  on  those  research  efforts  which  deal  with 
decision-making  in  a  riskless  environment.  An  assumption  is  made  that 
the  DM  is  an  individual,  although  extensions  may  be  made  to  the  group 
DM  case.  A  decision  is  classified  as  iskless  if  the  DM  is  able  to 
specify  with  certainty  the  consequences  associated  with  each  alternative 
action  (Fischer  et  al ,  1978).  In  HAUT,  consequences  are  evaluated  in 
the  context  of  the  DM's  preference  space.  The  first  stage  in  determining 
the  preference  space  is  to  form  a  hierarchy  of  objectives.  When  dividing 
an  objective  into  subobjectives,  it  is  important  that  the  subobjectives 
address  ail  facets  of  the  higher  level  objective.  Some  of  the  subobjec¬ 
tives  might  be  so  insignificant  relative  to  the  others  that  they  may  be 
discarded  from  the  analysis.  The  analyst  must  insure,  however,  that  the 
remaining  objectives  do  not  become  incomprehensible  (Keeney  and  Raiffa, 
1976).  Ellis  (1970)  documented  a  test  of  importance  which  would  facili¬ 
tate  proper  construction  of  the  objective  hierarchy.  Unfortunately,  a 
compounding  factor  in  decision  analysis  is  that  the  objective  hierarchy 
for  a  particular  problem  is  not  unique.  Furthermore,  the  set  of  attri¬ 
butes  which  is  de/eloped  to  measure  achievement  of  the  objectives  is  not 
unique,  even  for  a  specific  objective  hierarchy  (Keeney  and  Raiffa,  1976). 
As  a  result,  the  formulation  of  the  problem,  to  include  developing  the 
objective  hierarchy  and  the  attribute  set,  must  be  given  careful  consid¬ 
eration. 

In  particular,  there  are  several  properties  of  attributes  which 
Keeney'and  Raiffa  (1976)  have  designated  as  desirable.  Each  attribute 
should  have  the  properties  of  comprehensiveness  and  measurability.  The 


attribute  set  as  a  whole,  should  tv'  complete,  operational*  decomposable, 
non-redundant,  and  of  minimum  size.  In  those  cases  where  it  is  difficult 
to  choose  an  attribute  which  directly  measures  achievement  of  an  objective 
it  is  possible  to  utilize  proxy  attributes  and  direct  preference  measures. 
When  it  is  necessarv  to  use  proxy  attributes,  or  di-oct  preference  mea¬ 
surement,  it  is  important  to  ascertain  exactly  what  the  DM  perceives  as 
being  measured  (Keeney  anu  Ra’*ffa,  1976). 

In  general,  trruafb  T>  process  o  generating  an  objective  hierarchy 
arid  associated  attributes,  a  large  set  of  attributes  will  be  established. 
This  attribute  sc".  3  large  in  the  sense  that  the  quantified  preferences 
will  :.->re  accurately  reflect  the  true  preference?  of  the  DM  when  small 
parts  of  the  overall  model  can  be  considered  separately  by  the  DM  (Keeney 
nno  P-^ra,  19/6,  Toy? .  ^  key  factor  in  aiding  the  DM  is  to  generate 
ihose  subproolems  which,  while  preserving  the  original  complex  decision 
when  taken  as  a  complete  sec,  may  be  considered  individually  in  order  to 
maximize  consistency  and  understanding  in  the  DM.  This  process  of  de¬ 
veloping  an  ot.iective  hierarchy  and  the  set  of  associated  attributes  is 
discussed  in  more  detail  in  Chapter  II:  Problem  Formulation. 

After  the  objectives  and  attributes  are  satisfactorily  established, 
it  is  necessary  to  assume  that  any  alternative  consequences  are  capable 
of  being  compared  through  a  binary  preference  function,  and  that  the 
relationships  established  will  be  transitive  (Keeney  and  Raiffa,  1976). 
Practitioners  of  MAUT  attempt  to  construct  a  function  which  maps  the 
alternatives  onto  the  real  line  in  such  a  manner  as  to  incorporate  the 
DM's  implicit  preference  structure.  In  particular,  under  riskless  con¬ 
ditions,  a  value  function  is  sought  which  has  a  domain  over  the  cbriser 
quance  space  such  that 


v(xr  ....  xn)  >  v.(x{,  ....  <->  (x-j  j  ....  xn)  -V  (xj,  xn')  where 

£  is  read  "is  preferred  or  indifferent  to",  v  is  the  value  function  and 
(x1 ,  . ..,  x^h  (x{,  *')  are  elements  of  the  consequence  space. 

For  simplification,  this  development  includes  the  case  where  the 
factor  of  time  is  negligible  when  considering  preferences.  A  treatment 
of  preferences  over  time  is  available  in  the  works  of  Koopmans  (1960), 
Lancaster  (1963),  Koopmans  et  al  (1964),  Pollard  (1969),  and  Bell  (1974). 
While  considering  simplifying  assumptions,  it  might  be  noted  that  -con¬ 
fining  the  development  to  the  riskless  case  is  not  totally  restrictive. 
There  are  cases  in  which  a  simple  monotonic  transformation  to  a  riskless 
value  function  will  transform  space  into  a  utility  function  for  decision¬ 
making  under  risk  (Keeney  and  Raiffa,  1976). 

Within  the  restrictions  noted  above,  it  is  necessary  to  establish 
those  conditions  under  which  the  complex  decision  may  be  decomposed. 
Leohtif  (1947  a.b)  investigated  properties  of  functions  of  several  vari¬ 
ables  that  provided  for  separabil ity,  i.e.  breaking  the  original  function 
down  into  one  over  distinct  subsets  of  the  original  variables.  His  re¬ 
sults  were  local  rather  than  global.  Ah  important  contribution  toward 
separating  the  assessment  of  a  value  function  into  a  number  of  component 
parts  is  the  work  of  Gorman  (1968).  In  particular,  he  improved  the  use 
of  the  techniques  of  determining  the  conditions  necessary  to  imply  an 
additive  value  function  by  greatly  reducing  the  number  of  steps.  Ting 
(1971)  also  discusses  many  techniques  for  decomposing  the  assessment  of 
preferences,  and  suggests  some  guidelines  for  verifying  the  assumptions 
necessary  to  use  the  resulting  decompositions. 

Debreu  (1960)  provided  the  first  set  of  axioms  implying  the  exis¬ 
tence  of  an  additive  value  function  for  greater  than  two  attributes 
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through  an  elegant  topological  proof.  An  alternative  algebraic  proof 
of  additivity  was  given  by  Luce  (i%4)  when  he  introduced  the  concept  of 
conjoint  measurement  for  the  two  attribute  case;  It  might  be  rioted  that 
.most  procedures  for  developing  an  additive  value  index  assume  that  the 
index  has  the  properties  of  an  interval  or  ratio  scale  (Fischer  et  al , 
1978).  The  v/ork  of  Krant2  et  al  (1971)  provides  a  major  extension  of 
the  theory  of  conjoint  measurement.  Earlier  extensions  were  made  by 
Krantz  (1964),  Luce  (1966),  and  Tversky  (1967). 

MAUT  i.s  only  one  of  several  theories  developed  under  the  genre  of 
decision  analysis:  For  example,  two,  other  major  approaches  to  decision 
analysis  are  multiple  objective  optimization  theory  (MacCrimmon,  1973; 
'Dewispelare,  1980)  and  the  work  of  Bowman  (1963),  Yntema  and  Torgerson 
(1961),  and  Goldberg  (1970)  which  proposes  a  statistical  analysis.  How¬ 
ever,  'MAUT  has  been  used  effectively  within  the  context  of  military  man- 
agement.  Some  examples  of  these  applications  may  be  found  in  the  works 
of  Chinnis  et  al  (1975)  and  Ailen  et  al  (1977).  Chapter  III:  The  Value 
Function  discusses  this  topic  in  more  detail. 

There  are  several  practical  difficulties  which  obscure  an  objective 
analysis  of  the  worth  of  decision  aids  in  applied  contexts.  Included  in 
the  difficulties  are  the  frequent  absence  of  an  objective  criterion  to 
assess  decision  quality,  the  lack  of  parallel  decision  channels  which 
facilitate  comparative  studies,  and  the  unique,  non-repetftive  nature 
of  the  decision-making  environment.  Despite  these  problems,  seme  anec¬ 
dotal  evaluations  by  Kelley  (Fischer  et  al ,  1978)  reveal  that  in  the 
military  context,  decision  aids  appear  to  force  users  to  consider  both> 
option  values  and  likelihoods  explicitly.  The  benefit  of  numerical 
expression  of  uncertainty  as  opposed  to  verbal  qualifiers  is  evident. 
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The  structure  arid  explicit  requirements  of  the  decision  models  appear  to 
facilitate  coordinated,  efficient  action  by  staff  elements.  In  general, 
the  decision  models  serve  a  valuable  communicative  function.  (Fischer 
et  al ,  1978). 

In  light  of  the  apparent  success  of  early  attempts  to  inject  deci¬ 
sion  analysis  into  the  military  decision-making  environment*  concentra¬ 
tion  may  now  be  directed  at  refining  rather  than  justifying  the.  decision 
aids.  In  particular,  Kelley  points  out  that  the  areas  of  concern  include 
the  requirement  that  the  decision  mode  facilitate  communication  and  stor¬ 
age  of  rationale  for  values,  probabilities,  and  structures.  There  is  a. 
pressing  need  to  enhance  decision  analyses  to  include  multivariate  sensi¬ 
tivity  information..  Also,  there  is  a  significant  portion  of  potential 
users  (about  one-third)  who  require  special  help  from  the  decision  aid  to 
structure  the  problem  a'nd  generate  options  (Fischer  et  al ,  1978). 

Computer  implementation  has  been  an  increasing  medium  for  many 
approaches  to  decision  analysis.  Systems  Research,  Inc.  has  several 
aids  on  the  market  (CTREE,  QUICKTREE,  APLTREE,  DECISIONTREE,  INFLUENCE- 
DIAGRAM,  and  COMPUTERAID) .  Perceptronics ,  Inc.  has  marketed  a  package 
which  is  a  group  decision  aid. and  its  host  micro-computer .  Decisions 
and  Designs,  Inc.  under  the  sponsorship  of  the  Defense  Advanced  Research 
-Projects  Agency  have  produced  several  real-time  decision  aids  (DESIGN, 
TREE,  ITREE,  HIVAL,  PAYOFF,  and  NEGOTIATIONS).  Capt  Bruce  Mori  an  (1979) 
extended  some  of  the  products  of  DDI  as  a  thesis  while  at  the  Air  Force 
Institute  of  Technology.  More  recently,  Capt  David  Lee  (1981)  produced 
an  advanced  version  of  Mori  an 's  work.  Lee's  efforts  included  enhancing 
the  DM/deoision  aid  interface  through  the  use  of  colorgraphics ,  and  on 
improvement  of  the  sensitivity  analysis.  Lee's  decision  aid  is  designed 
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for  a  microprocessor,  and  was  built  around  the  APPLE  II  'hardware  and 
software.  Although’  his  work  does  exhibit  the  feasibility  of  using  a 
microcomputer  as  a  decision  aid,  it  is  highly  machine  specific  and  thus 
does  not  lend  itself  to  wide  application.  This  thesis  is  the  Multi- 
Attribute  Decision  Analysis  Model  (MADAM).  It  is  an  interactive  decision 
aid  utilizing  the  theoretical  constructs  of  MAUT  to  approach  hierarchi¬ 
cally  structured  problems.  MADAM  combines  the  increased  transportabil ity 
of  Mori  an 's  work  with  the  advantages  of  Lee's  work.  A  major  extension 
was  made  ' ^W/vss  of  problem  formulation  and  the  data  structure. 

The  serf  ti'v ,ty  analysis  has  been  expanded  to  include  a  system  analysis, 
over  a  set  of  nodes. 

In  Volume  I,  the  chapters  highlight  the  theoretical  aspects  of  MADAM 
and  the  methods  used  to  incorporate  these  aspects  into  the  model.  Chap¬ 
ter  II  discusses  problem  formulation:  establishing  a  hierarchy  of  ob¬ 
jectives  and  an  associated  attribute  set.  Chapter  III  contains  infor¬ 
mation  about  value  functions  and, their  implications.  Chapter  IV  high¬ 
lights  the  various  sensitivity  analyses.  Chapter  II,  ili,  and  IV  are 
divided  into  two  main  sections:  Theoretical  Considerations,  and  Computer 
Implementation.  This  is  done  for  the  convenience  of  those  familiar  with 
MAUT,  v/ho  may  skip  the  Theoretical  Considerations  and  read  only  the  Com¬ 
puter  Implementation  sections  without  any  loss  of  continuity-.  Chapter  V 
provides  a  detailed  prototype  decision  analysis.  Chapter  VI  contains 
conclusions  and  recommendations  concerning  further  work  on  this  model. 
Appendix  A  provides  a  concise  glossary  of  terms  which  may  be  unique  to 
the  model  or  unfamiliar.  Appendix  B  is  a  user's  manual  which  explicitly 
covers* use  of  MADAM.  Volume  IT  is  a  programming  manual  including  the 
source  code. 
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'  II.  Problem  Formulation 

Theoretical  Consideration 

MADAM  is  designed  for  a  complex  decision-making  environment.  The 
complexity  is  exacerbated  by  the  fact  that  rarely,  if  ever,  are  problems 
of  this  magnitude  neatly  laid  out  or  well  defined.  Unfortunately,  the 
DM  is  faced  with  a  vague  sense  of  what  problem  must  be  addressed.  The 
initial  stage  of  analysis  is  fraught  with  ambiguity  of  objectives  and  a 
lack  of  knowledge  about  their  interrelationships.  Thus,  a  critical  phase 
of  the  decision  analysis  is  the  first  stage;  problem  formulation. 

In  the  context  of  multi -attribute  utility  theory  (MAUT),  this  prob¬ 
lem  formulation  phase  consists  of  defining  the  boundaries  of  the  problem, 
developing  ah  appropriate  set  of  attributes  and  objectives  to  apply  to 

i  ) 

the  problem  (these  terms  are  defined  more  precisely  in  a  following  para¬ 
graph).  It  is  the  responsibility  of  both  the  DM  and  the  analyst  to  ensure 

that  proper  treatment  is  given  to  problem  formulation.  By-passing  care¬ 
ful  thought  at  this  stage  may  temporarily  eliminate  some  difficult  trade¬ 

offs,  but  any  decision  implies  such  crade-offs.  .By  keeping  as  many  of 
these  trade-offs  as  explicit  as  possible,  the  DM  may  ascertain  that  all 
responses  and  results  reflect  true  beliefs  and  values  (Fischer  et  al , 
1978).  . 

The  DM  should  be  able  to  place  the  problem  jn  the  typology  of  prob¬ 
lem  classifications  depicted  in  Figure  2.1 ;  This  step  in  itself  is  a 
potential  time-saver  in  that  it  will  indicate  what  type  of  decision  analy¬ 
sis  is  most  appropriate,  or  where  time  and  resources  may  be  conserved  by 
,  using  a  simpler  analysis  technique  than  was  originally  hypothesized. 


9. 


Those  problems  of  Type  I  and  Type  IJ.  are  relatively  simple  and  will  not 
be  considered  further.  Those,  problems  of  Type  IV  are  appropriately  adr 
dressed  by  MAUT  techniques  designed  to  incorporate  risk  or  uncertainty, 
type  IV  problems  are,  in  general,  beyond  the  scope  of  MADAM  except  in 
special  cases  where  risk  may  be  incorporated  artifically  as  an  attribute. 
More  generally,  MADAM  is  directed  at  Type  III  problems. 


(  ) 


Figure-  2.1  A  Problem  Typology 

(Adopted  from  Keeney  and 
Raiffa.  197.6) 


(  ) 


Those  problems  of  Type  III  and  Type  IV  can  be  represented  by  a  com¬ 
plex  system  of  objectives,  attributes,  and  alternatives.  In  MADAM,  an 
assumption  is  made  that  the  objectives  and  their  relationships  may  be 
represented  via  a  hierarchical  structure.  The  ultimate  purpose  of  such- 
an  approach  is  to  yield  substance  and  form  to  the  decision  environment, 
and  to  place  an  emphasis  on  interdependencies.  Often  analysts  Took  at 
only  part  of  a  problem  and  analyze  it  separately  to  reduce  the  problem 
to  a  manageable  size.  To  solve  a  complex  problem,  it  is  necessary  to  ex¬ 
tend  the  problem  boundaries  to  include  the  entire  relevant  system,  deter¬ 
mine  the  significance  of  interdependencies,  and  thus  evaluate  their 
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combined  impact  (Quade  and  Boucher,  1968).  It  is  unreasonable  to  conclude 
that  in  the  face  of  increasing  occupational  specialization,  all  subopti¬ 
mization  (solution  of  a  restricted  problem)  may  be  avoided,  but  it  is 
highly  desirable  to  insure  that  the  selection  of  criteria  and  objectives 
for  each  suboptimization  be  consistent  with  those  appropriate  to  the  full, 
complex  problem,  this  is  one  of  the  critical  functions  of  problem  formu¬ 
lation  (Quade  and  Boucher,  1968). 

The  efforts  expended  in  stating  and  defining  the  problem  are  paid 
back  through  a  vast  clarification  of  spurious  or  trivial  concerns,  and 
indications  of  a  more  direct  way  to  solution  (Quade  and  Boucher,  1968). 

The  process  of  problem  formulation  is  highly  subjective.  A  predominant 
force  at  this  stage  is  to  examine  what  is  meaningful  and  significant  to 
the  DM.  The  problem  formulation  stage  can  be  concisely  described  as  the 
phase  in  which  clarification  of  the  objectives,  defining  the  issues  of 
concern,  and  limiting  the  problem  ar.e  paramount  (Quade  and  Boucher,  1968). 
Within  the  perceptions  of  the  DM,  the  questions  or  issues  involved  must 
be  isolated,  and  the  context  of  issue  resolution  must  be  established. 

Along  with  clarifying  the  objectives,  the  operative  variables  must  be 
discerned,  and  the.  relationships  among  them  must  be  made  explicit.  All 
of  this  is  crucial  in  illustrating  the  logical  structure  of  the  decision 
analysis  (Quade  and  Boucher,  1968). 

The  Objective  Hierarchy.  In  MADAM,  the  process  of  problem  formu¬ 
lation  includes  constructing  a  hierarchy  of  objectives.  In  this  context, 
an  objective  is  an  entity  which  indicates  the  general  direction  in  which 
effort  will  be  exerted.  Note  that  an  objective,  is  distinct  from  a.  goal, 
in  that  a  goal  is  a  specific  level  of  some  measure  which  is  achieved  or 
not,  while  an  objective  denotes  no  specific  level  but  indicates  direction 


(Keeney  and  Raiffa,  1976).  Figure.  2.2  illustrates  s,  model  objective. 


to  (verb)  (object)  (modifier) 

e.g.  to  (improve)  (my  standard)  (of  living) 

Figure  2.2  A  Model  Objective 

Although  the  objective  hierarchy  is  not  unique  for  a  given  problem 
due  to  subjectivity  and  idiosyncrasies  of  the  DM,  there  are  general  prop¬ 
erties  which  the  objective  hierarchy  should  possess  (Keeney  and  Raiffa, 
1976).  As  one  moves  up  the  hierarchy,  the  subobjectives  should  indicate 
the  means  to  an  end,  where  the  end  is  indicated  by  a  parent  objective 
(see  Figure  2.3).  As  a  result,  the  movement  up  the  hierarchy  has  a  natu¬ 
ral  stopping  point  at  the  all-inclusive  objective.  This  objective  should 
give  the  overall  reason  for  the  DM's  interest  in  the  problem,  and  usually, 
it,  is  too  vague  for  operational  purposes  (.^eeney  and  Raiffa,  1976).  Con¬ 
versely,  as  one  moves  down  the  hierarchy,  the  parent  objective  of  a  set 
of  subobjectives  should  indicate  the  reason  for  the  existence  of  the  sub- 
objectives.  Unfortunately,  the  movement  down  the  hierarchy  has  no  well 
defined  stopping  point  (Keeney  and  Raiffa,  1976).  The  DM  must  determine 
the  extent  of  available  resources  and  take  a  pragmatic  attitude  toward 
the  amount  of  detail  which  is  desirable  (Quade  and  Boucher,  1968;  Keeney 
and  Raiffa,  1976) . 

The  process  of  breaking  a  parent  objective  into  subobjectives  is 

called  "specification"  (Keeney  and  Raiffa,  1976).  In  specification,  the 

objective  is  divided  into  subobjectives  which  provide  increased  detail. 

•» 

These  more  detailed  subobjectives  should  be  designed  to  encompass  all 
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Figure  2.3  A  Portion  of  the  Objective  Hierarchy 


aspects  of  the  parent  objective.  The  complexity  of  the  hierarchy  may  in¬ 
crease  beyond  realistic  bounds.  At  each  stage  of  specification,  the  set 

of 'Subobjectives  should  be  tested  to  ascertain  whether  or  not  some  of  the 

/ 

subobjectives  may  be  insignificant  relative  to  the  other.  If  any  such 
subobjectives  exist,  they  may  be  deleted  without  hampering  the  DM  *  s 
thought  process.  The  analyst  and  the  DM  must  exercise  care  when  elimi¬ 
nating  subobjectives,  however,  since  although  the  individual  subobjectives 
are  negligible,  a  group  of  them  considered  as  a  whole  may  be  too  signifi¬ 
cant  to.  ignore  (if  they  all  pertain  to  the  same  basic  area  of  interest) 
(Keeney  and -Raif fa,  1976). 

The  Attribute  Set.  .  The  process  of  problem  formulation  includes  the 
formation  of  an  attribute  set.  The  attribute  set  provides  a  means  of  • 
measuring  the  extent  to  which  the  lowest-level,  objectives  (and  thus, 


indirectly,  all  the  objectives)  are  satisfied,  The  lowest-level  objec¬ 
tives  show  the  degree  of  detail  vthi.ch  is  to  be  utilized  in  the  decision 
analysis,  and  the  attribute  set  contains  one  attribute  to  measure  each 
of  the  lowest-level  objectives  {see  Figure  2.4).  Just  as  there  is  no 
unique  objective  hierarchy  for  a  given  problem,  there  is  no  unique  attri¬ 
bute  set--even  for  a  given  objective  hierarchy  (Keeney  and  Raiffa,,  1976). 


Objectives  (having  associated  attributes) 


Despite  the  apparent  ambiguity  in  choice  of  the  attributes,  there 
does  exist  both  a  typology  of  attributes  and  a  description  of  desirable 
properties  as  found  in  Keeney  and  Raiffa  (1976).  There  are  three  types: 
of  attributes:  normal,  proxy,  and  direct  preference  measures.  Normal 
attributes  are  those. attributes  which  the  DM  considers  as  directly  mea¬ 
suring  their  associated  objectives.  Proxy  attributes  are  those  attri¬ 
butes  which  reflect  the  degree  to  which  the  associated  objectives  are  met 
although  they  do  not  directly  measure  the  objective  in  the  DM*‘S  mind.  An 
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example  of  a  proxy  attribute  wouid  be  to  use  the  attribute  "number  of 
v/ork  related  accidents"  to  measure  how  well  the  objective  "to  improve  job 
safety"  is  being  met.  The  last  type  of  attribute  is  the  direct  preference 
measure  where  the  DM  indicates  on  a  scale  of  worth  how  well  an  objective 
is  met  without  using  an  objective  measure  of  merit.  From  the  standpoint 
of  objectivity,  the  desirability  of  normal  attributes  exceeds  that  of 
proxy  attributes  which  in  turn  exceeds  that  of  the  direct  preference  mea¬ 
sure.  Some  caution  must  be  exercised  in  that  proxy  attributes  may  cause 
complications,  and  when  small  parts  of  the  model  are  considered  implicitly 
by  the  DM,  the  direct  preference  measure  may  more  accurately  reflect  the 
DM's  true  preferences.  Because  of  this,  Hatry  (1970)  extends  a  caveat 
concerning  excessive  use  of  proxy  attributes  in  spite  of  their  analytical 
ease,  or  easy  accessibility.  The  DM  and  the  analyst  should  insure  that 
the  DM  fully  understands  the  ramifications  of  using  any  proxy  attribute 
or  the  direct  preference  measure.  A. conscious  effort  should  be  made  by 
the  DM  to  consider  what  each  attribute  does  measure,  and  is  intended  to 
measure  (Keeney  and  Raiffa,  1976). 

The  attributes  should  possess  certain -desirable  properties.  The 
individual  attributes  should  be  comprehensive  and  measurable  (Keeney  and 
Raiffa,  1976).  An  attribute  is  comprehensive  if  the  DM  has  a  clear  under¬ 
standing  of  the  extent  to  which  the  associated  objective  is  achieved  by 
knowing  the  level  of  the  attribute  in  a  particular  context.  Ah  attribute 
is  measurable  if  a  probability  distribution  for  each  alternative  over 
the  possible  levels  of  the  attribute  can  be  established  (since  MADAM  is 
concerned  with  analysis  under  certainty,  a  point  value  must  be  determined), 
and  the  DM's  preferences  for  different  levels  .of  the  attribute  may  be 
determined  (Keeney- and  Raiffa,  1>976). 
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In  addition  to  the  properties  cf  an  individual  attribute,  there  are 
desirable  properties  of  the  set  of  attributes  as  a  whole.  These  proper¬ 
ties:  are  that  the  attribute  set  be  complete,  operational,  decomposable,, 
non-redundant,  and  minimal  (Keeney  arid  Raiffa,  1976).  A  set  of  attributes 
is  complete  if.  the  DM  is  satisfied  that  ah  indication  of  the  extent  to 
which  the  overall  objective  is  satisfied  is  given  by  the  level  of  the 
attributes.  Completeness  may  be  achieved  when  the  lowest-level  objectives 
in  a  hierarchy  include  all  areas  of  concern,  and  the  attributes  associated 

l 

with  them  are  comprehensive.  The  property  of  operational ity  comes  from 
the  attributes  having  meaning  to  the  DM,  and  having  a  -high  communicative 
value.  The  attribute  set  should  also  be  decomposable.  This  implies  that 
subsets  of  the  whole  attribute  set  may  be  examined  separately  from -the 
others  due  to  various  types  of  independence  (some  of  which  will  be  con¬ 
sidered  in  the  following  chapter).  It  might  be  noted  that  some  scientists 
have  developed  MAUT  analyses  which  do  not  utilize  (or  .require  determina¬ 
tion  of)  independence  conditions  (Fishburn,  1978;  Farquhar,  1979).  -The 
property  of  non-redundancy  means  that  the  attributes  should  not  allow 
double-counting  of  consequences.  For  instance,  if  two  attributes  used  to 
determine  the  quality  of  the  health  of  a  nation  are  "deaths1  due  to  cancer", 
and  "male  deaths",  one  would  be  double-counting  those  males  who  died  of 
cancer.  Finally,  the  attribute  set  should  be  kept  as  small  as  possible 
(eliminate  some  detail  in  the  objective  hierarchy)  subject  to  these  prop¬ 
erties  .< 

•:  'I  ' 

,j  '  .  “  ,  - 

f  }'  The  stage  of  problem  formulation  is  very  critical  i  Some  authors 

have  gone  as  far  as  suggesting  that  choosing  the  "right"  objectives  may 
be  more  important  than  determining-  the  optimum  choice  between  alternatives 
^  (Quade  and  Boucher,  1968).  The  essential  rationale  for  such  a  position 
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is  based  on  the  belief  that  a  near  optimum  solution  to  correct  problem 
formulatioh  will  be,  in  general,  superior  to  the  optimum  solution  to  ah 
il;l~posed  problem.  The  objectives  are  usually  less  subject  to  ephemer¬ 
al  ity  and  the  ravages  of  risk/uncertainty.  A  final  point  is  that  the 
process  of  problem  formulation  should  continue  until  the  DM  is  convinced 
that  any  further  decision  analysis  would  be  counter-productive.  The  DM 
should  feel  free,  and  be  encouragea  by  the  analyst,  to  modify  the  objec¬ 
tive  hierarchy  or  the  attribute  set  based  on  refined  perceptions  of  the 
nature  of  the  problem.  The  DM  must  be  conscious  of  changes  and  clarifi¬ 
cation  of  perceptions,  and  incorporate  them  into  the  model.  Also,  oper¬ 
ationally  significant  objectives  may  arise  out  of  the  opportunities  which 
possible  alternative  solutions  offer  (Quade  and  Boucher,  1968).  This 
type  of  information  will  occur  in  intermediate  phases  of  the  decision 
analysis  and  should  be  exploited  by  modifying  the  problem  formulation. 
Computer  Implementation 

In  order  to  facilitate  the  process  of  problem  formulation,  MADAM 

utilizes  a  data  structure  which  allows  storage  and  manipulation  of  the 

objective  hierarchy,  the  attribute  set,  and  the  set  of  alternatives.  A 

detailed,  programmer-oriented  description  is  included  as  a  programming 

1 

manual  along  with  the  full  program  listing  in  Volume  II.  For  the  pur¬ 
poses  of  this  discussion,  although  references  will  be  made  to  certain 
portions  of  MADAM,  every  effort  will  be  made  not  to  alienate  the  users 
who  are  not  concerned  with  coding  modification.  All  succeeding  chapters 
will  also  follow  this  policy  in  the  "Computer  Implementation"  sections. 

There  are  two  types  of  storage  of  "grouped"  or  similar  data?  arrays 
and  nodes.  An  array  is  simply  a  list  which  MADAM  recognizes  as  consist¬ 
ing  of  elements  which,  should  be  associated  with  one  another.  Thus,  for 
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example,  an  array  is  used  to  store  the  list  of  alternatives  to  be  evaluated. 
A  node  is  a  term  which  denotes  a  group  of  associated  information  which  is 
not  a  list  of  similar  items.  Thus,  for  example,  MADAM  uses  a  single  node 
to  store  an  objective  and  information  about  its  position  in  the  objective 
hierarchy.  Through  the  use  of  these  data  structures,  MADAM  is  able  to 
obtain  an  initial  problem  formulation,  and  allow  the  user  to  modify  the 
problem  formulation  at  a  later  time  in  the  decision  analysis. 

As  described  earlier  in  this  chapter,  the  key  elements  of  problem 
formulation  for  MADAM  ,re  formulating  the  objective  hierarchy,  establish¬ 
ing  the  attribute  set,  and  delineating  the  alternatives.  The  sequence 
of  routines  which  accomplish  this  are  accessed  when  the  user  calls  option 
***NEW***.  MADAM  will  take  the  user  through  all  of  the  steps  of  problem 
formulation  before  returning  to  the  main  option  selection.  For  nota- 
tional  purposes,  ail  user  options  will  be  delineated  by  asterisks  to  dis¬ 
tinguish  them  from  routines  which  have  the  same  name  or  function.  While 
actually  using  MADAM,  these  asterisks  should  be  ignored. 

The  Alternative  Set.  The  first  stage  of  the  problem  formulation 
will  be  to  input  the  current  list  of  alternatives  which  will  be  evaluated. 
MADAM  allows  the  user  to  input  a  list  of  10  letter  mnemonics,  each  of 
which  signify  a  particular  alternative.  This  list  will  be  stored  but  it 
can  be  modified  later  in  the  decision  analysis.  This  procedure  of  listing 
the  alternatives  is  done  first  so  as  to  exploit  the  previously  mentioned 
ability  of  the  alternatives  to  suggest  operational  objectives  by.  their 
vary  nature.  The  user  is  encouraged  to  make  any  notes  concerning  objec¬ 
tives  which  occur  at  this  point.  A  more  precise  description  of  using 
MADAM  is  provided  by  the  User's  Manual  (Appendix  B). 

The  Objective  Hierarchy;  As  the  user  exits  the  input  of  the 


18 


( J 


alternative  set,  the  next  task  to  be  accomplished  is  the  construction  of 
the  objective  hierarchy.  MADAM  facilitates  formulation  of  the  hierarchy 
by  utilizing  the  logic  shown  in  Figure  2.5.  The  user  begins  forming  the 
objective  hierarchy  by  inputting  the  overall  objective  which  indicates 
why  the  problem  is  under  consideration.  The  first  objective  is  considered 
the  initial  parent  objective  from  which  the  user  specifies  the  first  level 
of  subobjectives  (see  Figure  2.6  and  the  Glos?  .-Appendix  A).  After  the 


Figure  2.5.  Logic  Flow  of  Hierarchy  Construction  (SPAN) 
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Figure  2.6.  A  Portion  of  the  Objective  Hierarchy 


initial  set  of  subobjectives  is  established,  MADAM  queries  the  user  as  to 
the  existence  of  several  potential  sources  of  problems.  If  any  modifi¬ 
cation  of  the  set  of  subobjectives  is  required,  the  user  is  automatically 

directed  into  the  modification  routine  (MODIFY,  PRUNE)  so  that  the  offend¬ 
ing  subobjectives  may  be  corrected.  The  user  is  brought  back  into  the 
querying  phase  and  this  cycle  is  repeated  until  an  acceptable  set  of  sub¬ 
objectives  is  acquired.  At  this  point,  the  program  stores  the  informa¬ 
tion  (the  new  subobjectives  of  the  parent  objective),  and  then  chooses 
the  fii%t  subobjective  as  the  new  parent  objective.  The  preceding  pro¬ 
cess  is  repeated.  At  the  point  where  the  user  indicates  that  a  parent 
node  will  have  no  descendant  subobjective,  that  node  becomes  a  data  node 
(an  objective  which  will  have  an  associated  attribute),  and  the  current 

parent  node's  sibling  is  chosen  .as  the  new  parent  node.  If  there  are 

more  siblings,  MADAM  goes  back  up  one  level  in  the  hierarchy  to  look  for 
the  neare:t  sibling.  In  this  manner,  the  objective  hierarchyis  developed;  . 
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Figure  2.7.  An  Example  of  Depth- First  Ordering 

in  a  depth-first  fashion  (see  Figure  2.7  above),  It  is  important  to.  note 
that  the  subobjective  set  referred  to  in  the  previous  discussion  that  set 
of  subobjectives  which  speify  the  single  current  parent  objective.  Cur¬ 
rently,  MADAM  allows  for  up  to  nine  subobjectives  for  each  parent  objec¬ 
tive  and  for  a  total  of  500  nodes  (objectives)  in  the  entire  objective 
hierarchy-.  Relatively  minor  coding  modification  would  allow  for  a  re¬ 
laxation  of  these  numerical  restrictions . 

After  the  objective  hierarchy  is  completed,  the  user  has  a  local 
file  containing  all  the  input  information.  This  file  can  be  used  as 
temporary  storage  during  the  same  session,  or  for  permanent  storage  be¬ 
tween  sessions.  Within  a  single  session  MADAM  allows  the  user  to  work 
with  a  file  (tree  #),  and  to  change  files  through  the  notion  ***S£L***. 
The  data  is  stored  on  a  local  file,  so  no  information  is  lost  when  chang¬ 
ing  from  one  file  to  another.  As  long  as  the  user  exits  from  the  program' 
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normally  (***D0N***),  all  objective  hierarchies  and  associated  data  are 
stored  on  separate  temporary  files.  They  must  be  converted  to  permanent 
files  before  disconnecting.  This  procedure  (for  the  CYBER)  is  described 
in  the  User's  Manual.  Currently,  MADAM  allows  the  use  of  up  to  three 
separate  hierarchies  (tree  #'s)  in  a  single  session.  This  limit  may  be 
altered  by  changing  the  variable  NTREE  in  the  program  code-. 

The  Attribute  Set.  After  the  entire  objective  hierarchy  has  been 
input,  MADAM  automatically  shifts  to  the  routine  which  allows  input  of 
the  attribute  set.  Through  a  depth-first  search  pattern,  MADAM  finds 
each  data  node  and  allows  input  of  an  associated  attribute.  As  each  data 
node  is  encountered,  MADAM  allows  the  input  of  a  10  letter  mnemonic  for 
the  attribute  to  be  associated  with  that  node.  Several  questions  are 
asked  to  verify  the  validity  of  that  attribute,  and  if  modifications  are 
required,  the  cycle  is  repeated  (see  Figure  2.8).  Once  an  acceptable 
attribute  is  established,  the  user  inputs  the  best  and  worst  values  of 
this  attribute.  In  this  context,  best  means  that  level  of  the  attribute, 
which  is  most  preferred,  and  worst  means  that  level  which  is  least  pre¬ 
ferred.  There  is  no  distinction  about  which -value  is  numerically  greater;. 
For  example,  if  the  objective  is  "to  minimize  the  weight  of  the  radar  set" 
and  the  associated  attribute  is  WTKILO  (weight  in  kilograms)  then  the  best 
level  might  be  10  while  the  worst  level  might  be  100. 

After  all  of  the  data  nodes  have  been  presented  and  all  of  the  at¬ 
tribute  set  obtained,  the  entire  attribute  set  is  reviewed  and  screened 
for  other  problems.  Through  this  screening  (and  that  of  the  objectives) 
the  desirable  properties  of  the  attributes  and  the  attribute  set  (and 
the  objective  hierarchy)  are  infused  into  the  problem  formulation.  Folr 
lowing  the  construction  of  an  appropriate  attribute  set,  the  program 
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branches  to  the  routine  which,  will  examine  the  independence  conditions 
among  the  attributes  ( PPI ) .  The  process  of  testing  for  independence  and 
the  implications  of  the  types  of  independence  are  the  subject  of  the  next 
chapter:  The  Value  Function. 


III.  The  Value  Function 


Theoretical  Considerations 

After  formulating  the  objective  hierarchy  and  the  associated  attri¬ 
bute  set,  the  next  stage  of  a  MAUT  decision  analysis  involves  determina¬ 
tion  of  the  relationships  among  the  attributes.  This  is  important  because 
these  relationships  determine  the  mathematical  form  of  the  utility/value 
function.  The  ma then, ati cal  form  of  the  overall  utility/value  function 
will  determine  how  changes  in  the  attribute  levels  will  impact,  the  rela¬ 
tive  ranking  of  the  alternatives.  In  MAUT,  there  are  essentially  four 
techniques  for  obtaining  the  overall  utility/value  function  (Farquhar, 
1979).  They  are  the  decomposition  technique,  the  multi -valent  technique, 
the  approximation  technique,  and  the  spanning  technique. 

The  spanning  technique  is  a  relatively  new  approach  which  uses  the 
concepts  of  abstract  linear  algebra.  The  basic  idea  involved  is  to  de¬ 
termine  a  subset  of  the  attributes  which  "spans"  the  entire  set  of  attri¬ 
butes.  The  advantages  of  this  approach  are  that  the  DM  is  not  forced  to 
make  complex  trade-offs  between  the  attributes,  and  the  components  of 
the  overall  utility/value  function  is  a  combination  of  functions  defined 
over  the  individual  attributes.  Because  of  the  novelty  of  this  approach, 
the  theory  has  not  been  subjected  to  external  validation  through  applica¬ 
tion  to  practical  problems  (Farquhar,  1979).  For  this  reason,  the  span¬ 
ning  technique  was  not  implemented  in  MADAM. 

The  multi -valence  approach  is  also  a  new  technique,  and  it  involves 
determining  the  r-anges  over  which  eacli  attribute  has  certain  independence 
conditions.  This  allows  more  complicated  functions  to  be  represented  by 
the  use  of  several  simpler  functions  defined  over  domains  which  are  subsets 


of  the  original  more  complicated  function  (Farquhar,  1979),  This  approach 
was  discarded  for  use  in  MADAM  due  to  the  enormous  difficulties  associated 
with  developing  a  sensitivity  analysis. 

The  approximation  technique  was  used  in  DASS,  which  is  the  forerunner 
of  MADAM  (Morlan,  1979;  Lee,  1980}.  The  basic  approach  is  to  assume  that 
there  are  no  benefits  to  be  gained  by  going  to  a  more  accurate  function, 
and  thus  to  use  a  less  complicated  one.  DASS  incorporates  this  approach 
in  that  for  the  purpose  of  evaluation,  the  overall  value  function  is  as¬ 
sumed  to  be  of  the  additive  form.  In  addition,  the  sensitivity  analysis 
further  assumes  linearity  of  the  individual  value  functions  (functions 
defined  over  each  attribute  separately).  In  neither  case  's  any  attempt 
made  to  justify  these  assumptions  for  the  problem  under  analysis.  The 
rationale  for  such  an  approach  is  that  it  significantly  decreases  the 
time  required  for  decision  analysis  by  removing  almost  all  of  the  trade¬ 
off  analysis  between  attributes.  Theoreticians  and  practitioners  are 
split  as  to  the  validity  of  such  an  approach.  Some  indicate  that  rarely 
do  problems  arise  where  this  is  not  a  good  "first-cut"  solution  (Edwards, 
1977),  others  feel  that  use  of  approximation  techniques  are  too  mislead¬ 
ing  to  the  DM  to  be  of  practical  value  (Keeney  and  Raiffa,  19.76). 

The  decomposition  approach  involves  specifying  the  relationship:  be¬ 
tween  attributes  in  order  to  obtain  a  true  functional  form  for  the  over¬ 
all  utility/value  function.  MADAM  lies  between  an  approximation  approach 
and  a  full  decomposition  approach.  This  is  because  MADAM  does  test  the 
conditions  which  are  necessary  and  sufficient  conditions  for' the  use  of 
the  additive  value  function  but  it  does  not  consider  all  types  of  re¬ 
lationships  among  the  attributes.  Bec.ause  of  an  emphasis  in  efficiency, 
only  the  additive  decomposition  is  covered  by  the  model.  The  individual 


value  functions  are  fitted  through,  a  least-squares  procedure  rather  than 
assumed  linear  for  the  sensitivity  analysis.  The  rationale  behind  MADAM 
is  that  it  must  provide  enough  information  so  as  not  to  be  misleading 
but  in  the  interest  of  time  (and  practical  applicability),  it  is  necessary 
to  restrict  the  conditional  testing. 

Conditions  of  MAUT.  Before  examining  the  details  of  the  decomposi¬ 
tion  approach,  it  will  be  necessary  to  consider  some  fundamentals  of  MAUT; 
The  fundamental  axiom  of  MAUT  is  that  an  isomorphic  mapping- exists,  between 
alternative  actions  and  the  consequence  space  which  in  turn,  is  isomorphic 
to  a  set  on  the  real  line  (see  Figure  3.1).  The  mapping  of  actions  into 
the  consequence  space  is  done  by  functions  which  mimic  the  reality  of 
causation  (if-then  relationships).  The  mapping  of  the  outcome  space  onto 
the  real  line  is  accomplished  through  the  overall  value  function  (only 
the  riskless  decision  environment  will  be  considered).  This  mapping  into 
the  real  line  is  assumed  to  represent  the  DM's  true  preference  structure, 
that  is  to  say, 

v(x1,...,xn)  >  v(x.j,...,xjJ)  <~>  (xv,...,xn)  &  (x{».**»xj) 
where  ^  is  read  as  "  is  preferred  or  indifferent  to  " 

(x^,...,x  ),  (xj,...,x^)  are  elements  of  the  outcome 
space  and  y  is  the  overall  vatue  function. 


Figure  3.1.  Fundamental  Relations  in  MAUT 

(adopted  from  Keeney  and  Raiffa,  1976) 
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MAUT  is  predicated  on  the  concept  of  rationality.  That  is,  a  deci¬ 
sion  is  to  be  made  in  a  rational  manner.  In  the  context  of  a  riskless 
•environment,  a  decision  strategy  is  rational  if  any  two  consequences  may 
be  compared  relative  to  desirability,  and  all  comparisons  made  are  transi¬ 
tive  (i.e  x-|  y  *=>  x^>  x^)  (Fischer  et  a'l ,  1978).  Although  intu¬ 

itively  appeailing,  the  presence  of  transitivity  has  been  questioned  in 
some  applications*  and  this  stresses  the  importance -of  proper  problem  for¬ 
mulation.  Along  with  the  concept  of  transitivity,  a  fundamental  ^assumption 
of  MAUT  are  that  the  consequence  space  is  topologically  dense,  and  that  - 
the  attributes  are  compensatory.  These  assumptions  imply  that  one  can 
make  local  changes  which  preserve  indifference  about  any  point  in  the 
consequence  space,  and  thus,  the  indifference  curves  are  continuous  (-Fish- 
burn,  1977).  These  assumptions  make  it  meaningful  to  approach  the  prob¬ 
lems  of  establishing  indifference  curves  and  testing  independence  a'ssump-. 
tions  through  hypothetical  questions  which  allow  the  DM  to  lose  (or  gain) 
one  attribute  for  an  appropriate  gain  (or  loss)  of  another  attribute. 
Finally,,  traditional  MAUT  assumes  that  the  preference  function  (  >  )  is  a 
strict  weak  order  over  the  consequence  space  (Fishburn,  1977).  A  strict 
weak  order  is  a  binary  relationship  which  is: 
i)  asymmetric  (x^>-  x?  =>  not  x2  >  x-| ) 
and  ii)  negatively  transitive 

(not  x-|  not  x2  >-x3  ->  not  x.-|  kx3) 

The  Additive  Value  Function.  With  the  above  information  about  the 
assumption  of  a  MAUT  decision  analysis,  it  is  meaningful  to  consider  what 
a  particular  decomposition  implies  about  the  relation  hip  between  the 
attributes.  Also,  the  necessary  and  sufficient  conditions  for  a  particu¬ 
lar  decomposition  may  be  developed.  In  particular,  the  decomposition 


which  will  be  emphasized  is  the  additiye  form  of  the  value  function  (see 
Figure  3.,2).  The  additive  form  will  be  Considered  in  detail  because  it 
is  the  basic  decomposition  underlying  a  MADAM  decision  analysis,  and  be¬ 
cause  it  i.s  a  commonly  used  decomposition  in  other  decision  analytic  set¬ 
tings  . 

P Additive  Form;. 


V(x)  =  Z  w.v.fx.) 


i  i \ 


i=l , . . .  ,n 


Quasi -additive  Form: 


(•x)  =  >:{c.  v.  (x.  )...v.  (x.  ):  T<i,<..;,<i  <h,l<r<n} 

1-l  V'  'l  ’l  V  V  ~  1  r— 


Multiplication  Form- 


T"  1 

£{k  k.  .  . ,k  v  (x.  )...,v.  (x.  ):  l<i <i  <n,1<r<n)  : 

71  S-1!  ’l  V  V  ~  1  r~  *-  — 


n 

Note:  l+kv(>0  =  n  (1+kkiV. (x. )) 

i=l  111 


Diagonal  Form: 


V(x)  =  Z  c.v  (x  )+E{c  ,  f  (x  )...,f.  (x  } 

1-1  111  1  V  vi  S  V  V 


j  1  <i  <i  r_<r ,  2_<r<n } 

Figure  3.2  Some  Common  Decompositions 

In  order  to  derive  the  necessary  and  sufficient  conditions  for  the 
additive  value  function,  it  is  necessary  to  introduce  the  concept  of  "con¬ 
ditional  preference".  Let  A  be  the  set  of  all  attributes,  and  X,Y  are 
vectors  of  attributes  such  that  X,Yt:A,  X  a  Y=0.  Let  7.  represent 
EZeA:  Z  7.  oY=X>  X w  Y  v  Z=A] .  Then  two  elements  of  the  consequence- 

space  (x,y)  and  are  such  that  (x,y)  is  conditionally  preferred  to 


(x " ,y " )  givea  Z  if  and. only  :if  the  two  corresponding.  elements  of  the  full 
outcome  space  (x,y,z)  and  (x%y",z)  are  such  that  (x,y,z)  is  preferred  to 
(x'\y'\H  (Keeney  and  Raiffa,  1976).  This  may  be  written;: 

(x,y)  £,(x',y')<=>(x,y,x)  Mx",yV) 

This  conditional  preference  can  be  extended  by  defining  preferential  inde¬ 
pendence  as  that  condition  when  the  conditional  preferences  over  (x,y) 
space  do  not  depend  on  the  level  of  z  (Keeney  and  Raiffa,  1976).  Regardr 
less  of  what  level  of  z  is  chosen,  the  DM  would  indicate  the  same'  condi¬ 
tional  preferences.  This  condition  is  noted  by  {X,Y}PI{Z}.  the  natural 
implication  of  this  condition  is  that  trade-offs  .between  X  and  Y  may  be 
considered  without  regard  to  the  le.vel  of  Z. 

An  even  stronger  independence  condition- among  the  attribute  is 
called  "mutual .preferential  independence".  The  concept  of  mutual  prefer¬ 
ential  independence  (MPI)  denotes  the  condition  where  every  subset  of  the 
attribute  set  is  preferentially  independent  of  its  complement  (Keeney  and 
Raiffa,  1976).  That  is, 

(X , Y) PI (Z) ,  YX,Y,Z  A  (with  above  restrictions)' 


-*«1 . X^JMPI ,VX.€  A 

Not  only  is  this  condition  of  MPI  more  restrictive  on  the  attribute  set, 
but  it  appears  at  first  that  it  is  necessary  to  test  2n-2  different  sub¬ 
sets  of  the  attributes  in  order  to  verify  MPI  (Note:  PI  is  not  a  reflec¬ 
tive  operator:  {A}PI{BH-(B}PHA}) .  Fortunately,  there  is  a  theorem 
which  allows  the  number  of  cases  to  be  reduced  substantially.  The  theorem 
states  "  " 

Let  YCA,  ZC, A,  Y^Z=tf,  Y'  Z=Y=Z=A  {Y}PI{A-Y>,  {Z}P-I{A-Z}  .. 

(  )  then  _ 
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i)  YUZ 
it)  YuZ 

III)  Y-ZandZ-Y 
1v)  (Y-Z)u(Z-Y) 

are  each  PI  of  their  complements  (stated  in  Keeney  and 

Raiffa,  1976;  a  formal  proof  is  given  in  Gorman,  1958). 

In  particular,  the  above  theorem  allows  one  to  equate  pairwise  pre¬ 
ferential  independence  (PP.I)  with  MPI,  where  PPI  involves  testing  each 
pair  of  attributes  against  the  remaining  set..  3t  has  been  shown  that  the 
necessary  and  sufficient  concition  for  use  of  the  additive  value  function 
is  that  the  attributes  are  MPI,  hence  it  follows  that  a  necessary  and 
sufficient  condition  for  use  of  the  additive  value  function  is  that  the 

attributes  are  PPI  (Keeney  and  Raiffa,.  1976).  This  reduces  the  testing 
n 

to  ?.  cases,  and  it  is  this  latter  point  which  MADAM  exploits  in  deter¬ 
mining  if  the  additive  decomposition  is  appropriate  for  the  problem  at 
hand. 

Linearity.  In  addition  to  the  decomposition  used,  a  factor  which 
has  direct  impact  on  the  evaluation  oc  the  alternatives  is  the  choice  of 
the  individual  value  functions  (v..(x. ))  for  each  attribute.  In  particu¬ 
lar,  the  assumptions  made  concerning  the  convexity  of  the  individual  val¬ 
ue  functions  carry  implicit  information  about  the  preferences  of  the  DM 
(see  Figure  3.3).  The  implications  concern  the  DM's  rate  of  change  of 
preference  over  changes  in  the  attribute  level  (see  Figure  3.4).  It  is 
important  to  know  the  form  of  the  individual  value  functions  for  a  mean¬ 
ingful  sensitivity  anaiysis. 

In  order  to  save  the  DM  time,  DAS3  (the  forerunner  of  MADAM)  as¬ 
sumed  that  the  individual  value  functions  wore  linear  (Morlan,  1979;  Lee, 
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1981).  MADAM,  however,  uses  a  midvalue  splitting  technique  to  establish 
several  points  of  the  individual  value  function.  The  midvalue  splitting 
technique  is  an  approach  where  the  attribute  level  having  a  value  (to  the 
DM)  halfway  between  the  values  of  two  known  levels  is  solicited.  After 
several  points  on  the  curve  are  obtained,  a  reasonable  approximation  to 
the  individual  value  function  may  be  generated. 

Computer  Implementation. 

After  obtaining  the  objective  hierarchy  and  the  associated  attribute 
set,  it  is  necessary  to  test  or  assume  the  relationships  between  the  at¬ 
tributes.  MADAM  automatically  takes  the  user  throuqh  the  routines  (PPI, 
VALUE)  which  will  allow  the  testing  to  take  place.  All  testing  is  done 
via  a  hypothetical  question  approach  where  the  DM  is  asked  to  trade-off 
one  attribute  for  another,  or  to  move  between  levels  of  an  attribute. 

The  Additive  Value  Function.  Since  MADAM  is  ultimately  concerned 
with  the  validity  of  the  additive  decomposition,  MADAM  tests  to  see  if 
the  necessary  end  sufficient  condition  of  PPI  exits.  This  is  done  by  the 
routine  PPI  with  the  logic  flow  as  shown  in  Figure  3.5.  The  user  may 
specify  what  tolerance  is  desired  to  work  at,  which  reflects  considerations 
of  time  and  accuracy  in  decision  analysis.  When  the  tolerance  is  speci¬ 
fied,  the  user  is  taken  through  questions  involving  trade-offs  between 
two  attributes  with  the  other  attributes  arbitrarily  set  at  the  25%  level 
(25%  of  the  distance  between  the  worst  and  the  best  levels).  It  is  as¬ 
sumed  that  the  points  established  will  be  on  the  same  indifference  curve 
(which  is  true  if. the  user  understands  the  questions  and  the  trade-offs 
involved).  MADAM  then  checks  for  shifting  (in  shape)  of  the  indifference 
curve  by  moving  all  the  other  attributes  to  the  75%  level,  and  then  re¬ 
peating  some  hypothetical  trade-off  questions.  This  time,  however,  in 
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Figure  3.5  Logic  Flow  of  PPI 


order  to  minimize  user  frustration,  the  questions  are  phrased  in  a  yes/no 
fashion  where  the  user  indicates  whether  the  correct  level  would  lie  in  an 
interval  generated  by  the  program.  The  length  of  the  interval  is  a  func¬ 
tion  of  the  specified  tolerance  (see  Figure  3.6).  If  it  is  determined 
that  no  significant  (out  of  tolerance)  shifts  have  occurred  in  the  shape 
of  the  indifference  curve,  then  the  condition  of  PPI  is  supported.  After 
all  the  pairs  of  attributes  have  been  tested,  the  final  determination  of 
PPI  is  made. 

Currently,  MADAM  is  designed  to  output  any  violations  of  PPI,  if  any, 
but  it  does  net  handle  alternative  decompositions.  Even  if  PPI  is  vio¬ 
lated,  the  user  has  the  option  of  continuing  the  analysis  with  an  additive 
decomposition  (with  appropriate  warnings)  so  that  the  program  may  give 
the  user  any  desired  information. 


34 


\  reference  point 
\  (x.,x.) 

1  V 


Tolerance  /P?  - - 

window  ,<V/ 

/  <v0/ 


\*y 


<£/  V  ^ 


indifference 

curve 


Tolerance  window 


^I^Assumed 

vL  Tndiffp 


Indifference  Curve 


Figure  3.6  Testing  for  PPI 


Linearity.  If  the  condition  of  PPI  is  supported,  or  if  the  user  con¬ 
tinues  with  the  analysis,  MADAM  establishes  the  nature  of  the  individual 
value  functions.  This  is  done  by  the  routine  VALUE,  and  the  logic  flow  is 
given  in  Figure  3.7.  For  each  attribute,  the  midvalue  splitting  technique 
is  employed  to  generate  five  points  on  the  actual  individual  value  func¬ 
tion  (Actually,  two  of  these  points  are  given  boundary  conditions,  and 
three  internal  points  are  generated.).  By  using  a  least-squares  approach, 


the  data  is  fit  to  one  of  five  curves  based  on  minimization  of  the  sum  of 


Figure  3,7  Logic  Flow  of  VALUE 


squared  error  (see  Figure  3,8).  The  rationale  for  this  is  that  the  least- 
squares  approach  is  useful  to  compare  the  "goodness  of  fit"  of  alternative 
curves,  and  that  by  establishing  curves,  MADAM  may  internally  generate 
val.ues  based  on  levels  of  an  attribute  without  hav.ing  to  bother  the  user. 
The  curves  used  to  fit  the  data  are 

v  ■  b0  +  v 

'*  V  =  b  +  b,«fx# 

0  I 


? 

v  =  b  +  b.x 
o  1 

v  -  b  +  b,  Inx 
ol 

v  =  b  +  b.ex 
o  1 

where  v  is  value  and  x  is  a  level  of  the  attribute.  Although  these  curves 
may  not  fit  the  data  exactly,  they  do  provide  an  incorporation  of  the  con¬ 
vexity  question  for  the  purpose  of  sensitivity  analysis. 

As  each  curve  is  fit,  a  graph  is  output  to  the  user  to  see  if  it  is 
realistic.  If  it  is  not,  the  procedure  of  generating  points  may  be  re¬ 
peated.  At  all  times,  the  sum  of  squared  error  is  stored  with  each  pa¬ 
rameter  set.  Since  the  values  are  normalized  between  0  and  1,  it  is 
possible  for  the  DM -to  provide  a  cut-off  for  an  acceptable  level  of  the 
sum  of  squares  error.  If  all  of  the  regressions  exceed  this  limit,  the 
closet  fit  is  used  and  a  message,  is  generated  concerning  the  problem. 

The.  Overall  Value  Function.  After  PPI  has  been  verified,  and  the 
individual  value  functions  have  been  established,  the  user  is  returned  to 
the  main  option  selection.  At  this  point  the  user  should  enter  option 
***WCV***  in  order  to  enter  the  weights  for  the  nodes  of  the  objective 
hierarchy  (more  detail  is  given  in  the  User's  Manual).  The  user  will  be 
asked  to  enter  relative  .weights  for  the  descendants  of  every  parent  node, 
these  may  be  entered  directly  (not  necessarily  normalized.)  or  indirectly 
through  the  use  of  a  pairwise-comparison  matrix  approach  (Saaty,  1980; 
Williams  and  Crawford,  1-980).  When  the  weights  have  been  entered  for  the 
whole  hierarchy,  MADAM  is  able  to  calculate  the  coefficients  (w- )  for  use 
in  the  overall  value  function.  As  soon  as  all  of  the  levels  of  the  attri¬ 
butes  for  each  alternative  have  been  entered,  the  entire  decision  analysis 
is-  complete  except  for  the  sensitivity  analysis. 
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IV  SENSITIVITY  ANALYSIS 


Theoretical  Considerations 

An  important  force  behind  the  development  of  interactive  decision- 
aids  is  the  realization  that  a  sensitivity  analysis  of  the  model  para¬ 
meters  may  yield  important  insights  to  the  problem  under  consideration. 
Through  exploitation  of  the  virtually  instantaneous  computational  capa¬ 
bilities  of  the  computer,  the  DM  may  analyze  a  decision  problem  quite 
thoroughly  in  a  matter  of  several  minutes.  The  insights  gained  through 
varying  the  model  parameters  may  be  quite  important,  and  considerably 
different,  than  those  obtained  from  a  static  problem  analysis.  In  the 
hierarchical  type  of  problems  suitable  for  analysis  by  MADAM,  the  criti¬ 
cal  model  parameters  to  be  examined  in  a  sensitivity  analysis  are  the 
weights  assigned  to  the  nodes  in  the  hierarchy,  and  the  attribute  levels 
which  describe  the  alternative  systems.  MADAM  facilitates  a  thorough 
problem  analysis  by  allowing  a  sensitivity  analysis  over  the  weight  of 
a  particular  node  relative  to  its  siblings  (relative  weight),  the  weight 
of  a  particular  node  relative  to  the  root  node  (cumulative  weight),  attri 
bute  levels  at  a  particular  node,  and  a  particular  system  relative  to  a 
desired  set  of  nodes. 

Cumulative  Weight  Sensitivity  (CSA).  The  crux  of  the  cumulative 
weight  sensitivity  is  to  determine  how  the  overall  values  of  the  alter¬ 
native  systems  change,  relative  to  each  other,  when  the  contribution  of 
a  particular  node  to  the  hierarchy  is  modified.  For  a  given  alternative 
system,  the  overall  value  (value  at  the  root  node)  is  the  summation  over 
all  the  attributes  of  the  product  between  the  contribution  of  that  at-' 
tribute  and  the  value  of  that  attribute  level  assigned  to  the  system. 


This  can  be  expressed, 

j 

V.  =  I  (CUMWT . )  (v. .) 

1  v)  ’  J 

^  1  1 
d  i  \ 

attributes 

where  V.  is  the  overall  value  of  system  i 

CUMWT.  is  the  cumulative  weight  of  the  node  associated 
with  attribute  j 


For  analysis  purposes,  the  change  in  must  be  determined  for  given 
changes  in  a  particular  CUMWT..  This  change  may  be  determined  by  dele- 
ting  the  contribution  of  a  particular  node  to  the  root  node  and  replace 
it  with,  a  new  contribution.  The  contribution  of  a  given  node  to  the 
value  of  a  system  at  the  root  node  is  the  product  of  the  cumulative 
weight  of  the  node  and  vhe  particular  system  value  at  that  node. 

Unfortunately,  simply  changing  the  cumulative  weight  of  a  node  is 
not  sufficient.  When  the  cumulative  weight  of  a  node  is  modified,  the 
tree  structure  is  no  longer  normalized.  This  problem  may  be  ameliorated 
by  introducing  a  transformation  to  the  tree.  This  transformation  must  be 
such  that  the  modified  tree's  cumulative  weight  is  equated  to  one  minus, 
the  cumulative  weight  of  the  .perturbed  node  (Lee,  1981). 

This  transformation  can  be  incorporated  into  a  single  equation  so 
-that  the  desired  result  is:. 

v!  =  (v. .}  (CUMWT*)  +  (1  -  CUMWT* )/(l  -  CUMWT.)) 

1  *  w  J  J  J 

x(V.  -  fv.j)  (CUMWT.))  ■ 

where  . 

** 

V.  =  new  overall  value  of  system  i 
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V.  =  old  overall  value  of  system  i 

't 

v..  j  =  value  of  system  i  at  node  j 

CUMWT.  =  old  cumulative  weight  of  node  j 
J 

•fc 

CUMWT.  =  new  cumulative  weight  of  node  j 
0 

The  above  equation  may  be  used  to  evaluate  the  effects  of  desired  changes 
in  the  cumulative  weight  of  any  one  node  ori  the  overall  system  values. 

Relative  Weight  Sensitivity  (RSA).  In  a  relative  weight  sensitivity 
analysis?  the  desired  information  consists  of  those  changes  in  the  over¬ 
all  system  values  based  upon  changes  in  the  weight  of  a  given  node  rela¬ 
tive  to  its  siblings.  The  impact  of  modifying  the  relative  weight  of  a 
given  node  may  be  obtained  by  noting  that  the  value  of  a  system  at  a 
particular  node  is  a  function  of  its  value  ac  the  node’s  descendants  and 
their  relative  weights.  In  particular,  the  value  is  given  by: 


v  -  Z  <RELWTd)  <v1d) 
w  span 


where  v^  =  value  of  system  i  at  parent  node 

RELWTj  =  relative  weight  of  a  descendant 


v  ,  =  value  of  system  i  at  descendant  d 
id 

Examining  the  previous  equation  results  in  the  conclusion  that  a  change 
in  the  relative  weight  of  any  node  will  affect  only  the  value  of  a  sys¬ 
tem  at  the  parent  of  the  given  node.  Also,  the  value  of  a  sys tern  at  a 
given  node  is  dependent  only  upon  the  immediate  descendants  of  the  node. 
Thus,  in  calculating  the  change  in  overall  system  value  based  upon  per¬ 
turbations  in  the  relative  weight  of  a  given  node,  the  new  values  of  the 
alternative  systems  must  be  computed  and  substituted  for  the  initial 
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values.  These  new  values  can  be  directly  applied  to  see  how  values  at 
the  root  node  are  affected,  because  any  nodes  contribution  to  root  node 
values  is  a  function  of  its  cumulative  weight  (which  , is  constant  for  this 
analysis).  Combining  the  preceding  concepts,  the  ramifications  of  rela¬ 
tive  weight  modifications  are  given  by: 

v.*  =  v.  -  [ (CUMWT  )  (v.  )  +  (CUMWT  }  (v*  )] 

ii  pip  p  i  P- 

where 

* 

V.  =  new  overall  value  of  system  i 
V.  =  old  overall  value  of  system  i 
CUMWTp  =  cumulative  weight  of  parent 
v.  =  old  value  of  system  i  at  parent  node 

ic 

v,.  =  new  value  of  system  i  at  parent  node 

Since  there  is  some  ambiguity  as  to  how  to  deal  with  the  relative  weights 
of  the  siblings  of  the  modified  node  in  order  to  preserve  normalization,, 
an  arbitrary  decision  was  made  to  retain  the  relative  weights  of  the 
siblings  in  constant  proportions  (Lee,  1981).  That  is,  the  proportions 
between  the  relative  weights  of  the  siblings  (not  including  the  modified 
node)  would  be  preserved  after  [modification. 

Attribute  Level  Sensitivity  (LSA).  The  emphasis  behind  an  attri¬ 
bute  level  sensitivity  analysis  is  to  examine  the  rq^ustness  of  the 
"optimal"  solution  to  various  changes  in  the  level  of  a  particular  at¬ 
tribute.  For  the  purpose  of  such  an  analysis,  two  fundamental  assump¬ 
tions  implicit  in  MADAM  are  that,  first,  all  the  alternatives  systems  are 
independent  of  ea.ch  other.  That  is,  changes  in  the  attribute  levels  of 
one  alternative  have  no  influence  on  the  attribute  levels  associated  with 
the  other  systems.  Second,  therelative  and  cumulative  weights  of  the 
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nodes  are  assumed  to  be  unaffected,  by  a  modification  in  a  system's  attri¬ 
bute  levels  (Lee,  1981).  Under  these  assumptions,  only  the  perturbed,  sys¬ 
tem  will  experience  changes  in  overall  value,  and  the  change  experienced 
is  a  direct  function  of  the  cumulative  weight  of  the  node  associated  with 
the  attribute  which  is  being  changed.  This  may  be  represented: 

Vf  "  Vi  -  (C»V  lvUl>  +  (CUH“V  <W> 

where 

* 

V.  =  new  overall  value  of  system  i 

V.  =  old  overall  value  of  system  i 

CUMWT  =  cumulative  weight  of  node  a 

v.j  £  =  old  value  of  system  i  at  a  node  a  with  old 
attribute  level  % 

viaf*  =  new  va1ue  system  i  at  node  a  with  new  attri¬ 
bute  level  Z* 

System  Sens i ti vi ty  (SSA).  As  noted  in  each  of  the  preceding  forms 
of  sensitivity  analysis,  they  dealt  with  the  changes  in  the  overall  values 
of  all  the  systems  given  that  a  single  node  w as  perturbed.  Another  per¬ 
spective  which  yields  different  but  valuable  information  is  to  consider 
how  the  overall  value  of  a  single  system  changes  over  perturbations  of  a 
set  of  nodes.  Due  to  limitations  on.  abs-traction  abilities,  it  is  not 
very  fruitful  to  consider  simultaneous  changes  over  the  set  of  nodes. 

There  is  also  a  severe  problem  of  dealing  with  an  ambiguous  rate  of  change 
when  attempting  a  simultaneous  change  of  the  factor  (RELHT,  CUMWT,  or 
LEVEL)  under  consideration.  As  a  result,  the.sytem  analysis  is  a  concise 
representation  of  overall  value  repcnse  to  modifications  on  each  node  in 
the  desired  set  taken  independently.  This  approach  allows  the  use  of  the 
formulae  occurring  in  the  single  node  analysis  while  providing  the  DM  with 


information  concerning,  the  robustness  of  a  possible  alternative  over 
changes  occurring  in  a  chosen  set  of  nodes. 

Since  the  previous  formulae  are  valid  in  this  approach,  it  is  pos¬ 
sible  to  do  a  system  analysis  over  changes  in  cumulative  weights,  rela¬ 
tive  weights,  and  attribute  levels  corresponding  to  a  desired  set  of  nodes. 
Computer  Implementation-. 

MADAM  allows  the  user  to  do  all  the  forms  of  the  sensitivity  analy¬ 
sis  described  in  the  preceding  section.  The  sensitivity  analyses  are 
accessed  through  the  main  option  ***SEN***.  Use  of  this  option  will  re¬ 
sult  in  a  new  set  of  choices  which  determine  which  type  of  analysis  will 
be  conducted.  After  the  data  file  is  complete,  either  by  using  options 
***NEW***  and  ***WVC***,  or  by  taking  a  stored  data  file  and  using  the 
appropriate  options,  there  is  no  limit  (subject  to  computer  time  restric¬ 
tions)  to  the  number  of  analyses  which  may  be  performed.  The  output  for 
all  the  analysis  options  are  provid'd  in  both  a  tabular  and  graphical 
node  (see  Figures  4.1  and  4.2). 

Cumulative  Weight  Sensitivity.  Utilizing  the  approach  described  in 
the  theoretical  section  of  this  chapter,  MADAM  generates  a  matrix  con¬ 
taining  overall  system  values.  Each  column  of  the  matrix  corresponds  to 
an  alternative  system  for  a  direct  CSA,  PSA,  or  LSA.  Each  column  repre¬ 
sents  a  different  node  for  SSA  with  a  CSA  suboption.  Each  row  represents 
a  different  cumulative  weight.  This  matrix  is  expressed  ir.  a  tabular  or 
graphical  fashion  as  shown  in  Figures  4.1  through  4.4.  The  dominant  al¬ 
ternative  system  is  marked  by  an  asterisk  for  each  cumulative  weight 
(CUMWT)  value.  The  tabular  output  may  be  used  to  ascertain  the  dominant 
options  over  a  range  of  the  CUMWT,  and  the  graphical  output  may  be  inter¬ 
preted  to  see  which  systems  (nodes)  are  very  sensitive  to  CUMWT. 
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KOR  NODE: 

<Associated  objectiVe> 


CIJMWT 

/  or  \ 

!  RELWT  ' 

1  or 

|  <SYS  1> 

<SYS  2> 

<S\'S  n> 

\  LEVEL ) 

x.xx 

XX.  XX* 

XX. XX  ... 

XX.  XX 

x.xx 

XX.  XX 

XX. XX*  ... 

XX.  XX 

X 

X 

X 

XX.  XX 

XX.  XX  ... 

XX. XX* 

(*indi 

cates  dominant 

alternative) 

Figure  4.1.  Tabular  Output  for  direct  CSA,  RSA,  or  LSA 


LEGEND: 

SYMBOL  =  A  IS  SYSTEM:  •'SYS  1>  SYMBOL  =  B  IS  SYSTEM KSYS 2> 
SYMBOL  =  C  IS  SYSTEM:  <  > 


CUMWT 
or  \ 
RELV/T  | 
or  1 
LEVEL/  0 


80  TOO 


\  B  C 
ABC 
—A- 8 — e- 
HA  C 


0  20  40  60  80  1 

OVERALL  VALUE 


Figure  4.2.  Graphical  Output  for  direct  CSA,  RSA,  or  LSA 
(expanded  option  changes  x  axis) 


Relative  Weight  Sensitivity.  MADAM  utilises  the  formula  presented 
in  the  theoretical  section  of  this  chapter  for  a  relative  weight  sensi¬ 
tivity.  A  matrix  of  overall  system  values  is  generated  where*  for  the 
direct  RSA,  each  column  corresponds  to  an  alternative  system.  For  the 
SSA  option  with  the  RSA  suboption  each  column  represents  a  different  node 
Each  row  corresponds  to  a  different  value  of  relative  weight  (RELWT), 

This  analysis  allows  both  tabular  and  graphical  output  of  the  data  as 
shown  in  Figure  4.1  through  4.4.  The  tabular  analysis  rnay  be  used  to 
readily  identify  the  dominant  option  at  a  particular  value  of  the  rela¬ 
tive  weight  of  the  node  (nodes)  under  consideration.  For  the  direct  RSA, 
the  graphical  analysis  will  show  the  relative  sensitivities  of  the  al¬ 
ternative  system  for  changes  in  the  relative  weight  of  a  given  node.  The 
SSA  option  with  RSA  suboption  will  indicate  to  which  nodes  the  given  sys¬ 
tem  is  most  sensitive  based  on  changes  in  relative  weight. 

Attribute  Level  Sensitivity.  Using  the  formula  presented  in  the 
theoretical  section  of  this  chapter,  MADAM  allows  the  user  to  conduct  an 
attribute  level  sensitivity.  A  matrix  of  overall  system  values  is  gener¬ 
ated  where,  for  the  direct  LSA,  each  column  represents  an  alternative 
system.  For  the  SSA  option  with  a  LSA  suboption,  each  column  represents 
a  different  node.  For  the  direct  LSA,  each  row  represents  a  different 
actual  level  of  the  associated  attribute.  For  the  SSA  with  a  LSA  sub¬ 
option,  each  row  represents  a  different  value  where  value  is  an  entity 
into  which  attribute  levels  are  transformed  via  the  individual  value  func 
tions.  This  conversion  is  made  so  that  a  single  graph  or  table  may  be 
used  to  output  the  data.  The  output  is  presentee!  in  either  a  tabular  or 
graphical  format  as  shown  in  Figure  4.1  through  4.4.  The  table  may  be 
used  to  identify  the  dominant  system  for  a  given  attribute  level  in  the 
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case  of  direct  LSA.  The  graphical  output  may  be  used  to  discern  relative 
system  sensitivities  to  changes  in  a  particul?-.  attribute  for  a  direct 
LSA.  For  SSA  with  an  LSA  suboption,  the  graphical  output  will  yield  those 
nodes  to  which  the  given  system  is  most  sensitive  based  on  changes  in  raw 
value  at  the  individual  attribute  level. 

System  Sensitivity.  The  system  analysis  allows  the  user  to  use  one 
of  the  prior  analyses  over  a  set  of  nodes  as  opposed  to  a  single  node. 

In  this  analysis,  however,  it  is  the  system  (rather  than  the  node)  which 
is  fixed,  and  the  columns  or  symbols  represent  different  nodes  as  opposed 
to  different  systems.  For  use  of  this  analysis  with  either  the  CSA  or 
RSA  suboption,  the  y  axis  of  the  output  is  the  same  as  for  the  single  node 
option  (direct  CSA  or  RSA).  When  the  LSA  suboption  is  involved,  the  y 
axis  represents  raw  value  rather  than  actual  attribute  levels.  It  would 
be  necessary  to  convert  these  raw  values  to  attribute  levels  using  the 
individual  value  functions  if  an  interpretation  of  a  particular  node  is 
to  be  made.  Since  the  analysis  is  made  over  a  single  range  of  the  vari¬ 
able,  a  broad  enough  range  must  be  chosen  so  as  to  include  the  largest 
range  of  interest  on  any  of  the  individual  nodes.  There  is  no  restriction 
to  the  nodes  which  may  be  chosen  except  that  a  level  (value)  analysis  is 
possible  only  at  a  data  node. 

The  above  sensitivity  analyses  put  a  set  of  powerful  analytical 
tools  at  the  fingertips  of  the  DM.  Because  of  the  use  of  computerization, 
a  very  thorough  analysis  may  be  generated  in  a  relatively  short  period  of 
time.  This  analysis  will  provide  information  concerning  the  robustness 
of  the  dominant  alternative  over  a  wide  range  of  parameter  changes.  This 
is  important  because  the  stability  of  the  solution  may  be  more  important 
than  its  static  value,  particularly  in  those  decisions  where  several 
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The  sample  problem  noted  above  is  highly  simplified  and  will  serve 
only  to  illustrate  the  mechanics  of  using  MADAM.  The  following  data 
will  be  used  to  generate  the  necessary  tables  and  graphs.  All  data  is 
totally  hypothetical  and  no  attempt  has  been  made  to  mimic  actual  data 
classified  or  unclassified  (see  Table  5.1) 


Mnemonic 

Attribute 

- - - - - 

Level 

Sys  tern 

objecti ve 

4.5 

F-4 

111  AERO 

rating  scale 

8.0 

F-l  5 

(0-10) 

3.0 

MU 

objective 

1  .0 

F-4 

LO  AERO 

rating  scale 

.5 

F-l  5 

(0-10) 

3.0 

F-l  11 

probabil ity  of 

.2 

F-4 

VULNER 

being  killed  on 

.1 

F-l  5 

a  model  sortie 

.25 

F-l  11 

4.0 

F-4 

AIR-AIR 

subjective  rating 

4.5 

F-l  5 

0-5) 

2.0 

F-l  1 1 

2.0 

F-4 

AIR-GROUND 

subjective  rating 

1  .5 

F-l  5 

(1-5) 

1  .75 

F-m 

3.0 

F-4 

RECCE 

subjective  rating 

1  .25 

F-l  5 

3.5 

F-l  11 

Table  5.1  Scenario  Data 


The  following  pages  are  an  example  of  how  this  problem  might  be 
analyzed  using  MADAM.  There  are  intentional  errors  made  during  the  analy 
sis  in  order  to  illustrate  the  program's  graceful  recovery  capabilities. 


WHAT  IS  YOUR  NAME »  PLEASE? 

AT  O'r --  OOl  SN«APTT 

60000  CM  STORAGE  USED. 

6.740  CP  SECONDS  COMPILATION  TIME,  w . st  imp-son 
THANK  YOU ?  W. STIMPSON.  WE  WILL  NOW  BEGIN  THE 
DECISION  ANALYSIS . 

OPENING  PILL  NUMBER  1 

IS  THIS  DATA  NEW  (N>  UR  STORED  (S)?r. 


W . ST I MESON , YOUR  GET IONS  ARE i 

AT  f  COE  DIS  DON  MUD  NEW  NUM  PRO  REV  SET... 

SEN  SPA  S I A  SYS  TIL  WVC 

**.*NOTEt  IF  YOU  NEED  AN  EXPLANATION?  W . STIMPSON 
TYPE  “HELP"  .m 

WHAT  IS  YOUR  CHOICE? '  W  ♦STIi1PS0N?new 

THE  FOLLOWING  INFORMATION  WILL  ALLOW  YOU  TO  CHOOSE 
AN  EXISTING  (STORED)  DATA  FILE?  OR  TO  CONSTRUCT  A 
NEW  ONE?  W. STIMPSON. 

THE  CURRENT  TREE  IS  NUMBER  1. 

WITH  WHICH  1  REF.  WOULD  YOU  LIKE  TO  WORK?  W . STIMPSON?  1 

OPENING  PUL'  HUMBER  :i 

IS  THIS  DATA  NEW  <N)  OR  STORED  (B)'iT 

FILE  t  HAS  NO  CURRENT  I  REE  STRUCTURE.  YOU  ARE 

BEING  TRANSFERRED  TO  OPTION  NEW 


YOU  ARE  AT  THE  POINT  WHERE  YOU  WILL  BE  ENTERING 
THE' ALTERNATIVE  SYSTEMS  WHICH  WILL  BE  RANKED 
IN  TERMS  OF  PREFERENCE*  PLEASE,  CHOOSE  THE 
APPROPRIATE  OPTION. 


DtELETE 


N  <  EW 


E  ( X I T 


ENTER . 

.  .SYSTEM  ' 

1 

LABEL 

(10  LE 

ITERS 

OR 

LT 

:ss) 

?  r 

-A 

ENl  1":  R  * 

.  » CYST 

EM 

*;> 

LABEL 

no  m: 

T  i !.  KS 

OR 

Lf! 

:ss> 

Tf 

-IT, 

ENTER , 

* . SYSTEM 

3 

LABEL 

(10  LE 

TTL  RS 

OR 

U. 

!SS) 

Y  P 

-111 

ENTER ♦ 

♦  <  BY S i 

'EM 

A 

LABEL 

(10  I.E 

TIERS 

OR 

ul. 

roe  % 

wWf  ,  f  / 

YOU  ARE  AT  THE  POINT  WHERE  YOU  Will.  PE  ENTERING 
THE  ALTERNATIVE  SYSTEMS  WHICH  UHL  fill  RANKED 
IN  TERMS  Or  PREFERENCE.  PLEASE  CHOOSE  THE 
APPROPRIATE  OPT 3  ON  ♦ 


A  (Oil 


DCELETL 


N(EW 


t:  (XII 


' ADDING  SYSTEM 
LABEL?!'  -2  00 

USE  WOC  *:h*  I- UK  HI!  IT.  RUNG  VAllJI.S 

AND  RECALCULATING  TRIE  CAI-  NECESSARY), 


YOU  APE  AT  THE  POINT  WHERE  YOU  WILL  BE  ENTERING 
THE  ALTERNATIVE  SYSTEMS  WHICH  WILL  HE  RANKED 
IN  TERMS  OH  PRI: FERENC E .  PLEASE  CHOOSE  THE 
APPROPRIATE  OPTION, 
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A  ( Mi 
?d 


D  ( F  LET  17. 


N<EW 


E  ( X I T 


CURRENT  SYSTEMS.  .  . 

F-4 
F--5.G 
i  •-].  :i.:L 
F- !  Oij 

EH  TER  7  HE  SYSTEM  TO  HE  DELETED. 
Tf-IOS 


YOU  ARE  A 1 
IKE  ALTERA' A 
IN  T Els Hi>  Or 
A  P  PROPRIA"! 


THE  POINT  WHERE  YOU  WILL  HE  ENTERING 
i  ILL  SYSTEMS  WHICH  WILL  BE  RANKED 
PREFERENCE.  PLEASE  CHOOSE  THE 
OP  now  * 


A (DB  D (LLETE  N(EW  E(XIT 

?d 


CURRENT  SYSTEMS.  .  . 

F-4 
F-  VJ 
F-iU 

ENTER  THF  SYSTEM  TO  BE  DELETED. 
?f-5 

SYSTEM  F-;:i  NOT  FOUND 


YOU  ARE  AT  THE  POINT  WHERE  YOU  WII..I. 
THE ’ALTERNATIVE  SYSTEMS  Wil  l  Ci I  WILL 


BE  ENTERING 
HE  RANKED 


A  <  Dll  IHELETE  N(EW  E(XIT' 

?e 


ENTER  A  TITLE  FOR  THIS  DATA  STRUCTURE ♦  ♦  . 

1’this  example  is  intended  to  illustrate  the*  capabilities  of 
‘THADAiir  and  in  no  way  reflects  real  data  (classified  or 
'‘•’unclassified  >  *  all  preferences  and  values  are  hypo  the  tics  1  * 
? Wayne  A.  St imps on  19  Nov  1981 


SPANNING  NODES i  "A “-ALL  * S° -SELECT 

?a 


DO  YOU  WISH  TO  BUILD  A  NEW  TREE#  W.STJMPSON?  (Y/N) 

?y 

DO  YOU  WISH  TO  BY-PASS  THE  BETWEEN  NODE  CHECKTn 
ADDING  DOWNLINKS  TO  NODE  1 
0 

W ,  SI  ]  HP  SON  •  WilAl  [S  THE  NEXT  SUBOBJECTI VE? 

(USE  MO  MORE  THAN  I  WO  00  CHARACTER  LINES ) 

?tc)  obtain  the  beat  available  I.  :?n<> 

PLEASE  CONTINUE 

?for  forward  deploy  merit 

THE  LAST  BUBOBUECYTVE  ENTERED  IS t 

TO  OBTAIN  II HE!  BEST  AVAILABLE  PLANE 


FUR  FORWARD  DEPLOYMENT 


CURRENT  NUMBER  OF 
CURRENT  HUMBER  OK 
CUR REN r  NUMBER  OF 


NODES J  2 (MAX  500) 
1-E.VEI.S:  2  (MAX  20) 
OYSTEMS:  3 (MAX  S9) 


ADDING  DOW  Ml.  INKS  TO  NODE} 


1 

TO  OBTAIN  THE  BEST  AVAILABLE  PLANE 


FOR  FORWARD  BE  PI.  0  V  ME  NT 


W.STtMPSON»  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 
(USE  NO  MORE  THAN  fWu  00  CHARACTER  LINES) 
?to  ifiyxiiti  i.zt>  c3€'rod'.;n:;mj  c  >*r?rf ormoncn 
PLEASE  CONTINUE: 

o 

THE  LAST  SUjBDBJLCT:!  VE  EN'I  FRFB  IS  I 
TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


WHICH  IS  SUBOBJECT 3 VH  NUMBER  I 
FOR  THE  OBJECT IV IN 

TO  OBTAIN  THE  BEST  AVAILABLE  PLANE 
FOR' FORWARD  DEPLOYMENT 


IJ *.  ST  I  HP  SON y  WHAT  IS  THE  NEXT  SUBOfiJECTlVE? 
(USE  NO  MORE  THAN  TWO  BO  CHARACTER  LINES) 
?to  m r, : :  ;L  m i  z  e  ; n  re  r b f  l  u u  r v  i  v .? h  i.  1  :i.  i y 
PLEASE  CONTINUE 
? 

THE  LAST  SUBOBJECTIVE  EMI  ERE  IT  IS* 

TO  MAXIMIZE  A IRC RAF T  SURVIVABILITY 


WHICH  IS  8U SUBJECT  I VE  NUMBER  2 
FOR  THE  OBJECTIVE: 

TO  OBTAIN  THE  BEST  AW  IT. ABLE  PLANE 

FOR  FORWARD  DEPLOYMENT 


56 


W.STIM?SON»  WHAT  IB  THE  ME XT  HUBOBJECTIVE' 
CUBE  NO  MORE  THAN  UJO  BO  CHARACTER  LINES) 
?to  o  pi  i  nil"*,  a  sriulti.Tcle'  cornbat 
P LEASE  CONTINUE 
■Testability  ' 

THE  LAST  SUl.'OEJECTIVE  ENTER!;  .0  I  Si 
TO  on.!  MIZE  MUL)  .[--ROLE  COOT:  A  I' 

CAP  A  ML  I TV 


WHICH  IB  SUBOBJEM  I'VE  NUMBER  B 
FOR  TOP:  OBJECTIVE; 

TO  GUTA  IN  7 1  If:  OPTS  I  nVAi  I.ABl.E  PLANK 


FOR  FORWARD  LoL-.lM  QYMENT 


U*SriMPSOH»  WHAT  i:s  THE  NEXT  SUBOB JE CTIVE? 
< USE  NO  MORE  THAN  TWO  00  CHARACTER  LINES) 


8  0!  (<?  0  p  (f)  (/.’  P  0  0  (':  0  0  0  0  (•?  0  0  (•?  i?  O':  ii:  0  O'  l?  (•>  0  8  P  (-}  8  8  0  8  P  P  p  (<>p  8  p  e 
PTC)  on  CAIN  THE  REST  AVAILABLE  PLANE  « 

@  e 

PFUR  ■  FORWARD  DEPI..UYHL.N  T  © 

6  8 

{?  (?  8  0  0  0  (?  P  8  p  A  {-)  p  8  P  P  PP  8 0 0  8 0 8 0 0  0  8  0 1  ?  0  -0  0  0  0>  0  P  0  (•?  i  r?  0  0 

U  1  ). 

0  8  8  0  P 0 8 0 00 0 0 0  ( ! 0 0  0  0  (?  0  fi  8 0 0  8  0 0 8 8 0 8  8 8 0 0 8 0 0 0  P  ;■ 

0  -0TU  MA/:i  MIZE  A  ERG  DYNAMIC  PERFORMANCE 

8  P 

00  MAH'?  POPP 
8  0 

8  0  P  0 0 8 0 0 1?  p  w  0 8 8  0 0  0  0  G? 8  8 0  8 8  P  0 8 8 0  0 0  0 8 0  0 8 0  0  0  0  0 

8  i  2 

0  .  (? ('? p C? P cm;? P {;> i.>888 0 (.) 8 8 p p p p @ p p p p 8 § 0 p ® 0 8 8 8 0 0 0 P ('■ 

§  0TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 

8  0 

ppppp  (;>(;?(.?  f/<8 
0  0 

0  {?  8  0  (;'  8 (-?  8 1*  8  8  8  P  p  p  p  0  p  0  p  0  0  p  0  p 0  0 0  0 0  0  0 p 8 0 8 8 0  P  0!  p 

8  A  3 

0  p  p  0  (;• 0  0 0 P  0  0  0 0  0 0  0  0  g  0  0  0 0 0  0 (3'0 0 0  0 0  0 0 0 0  (;? 0 8 0 0  P  0 

P  81 0  OPT.!  MIZE  MULT.!  -ROLE  COMBAT 

C  0 

P0P 088 PC’ PNC  'ti  -AB  ) !  J.  JY 
(?  P 

0  0 0 !<)  0  0  p  p  0  0  0  p  0  ij;  0  0  0  0  0 0  0  0  0  0 0 0  0 p  0  0  0  8@  0  P 88 88 0  (IL 


W .  STIMPVSOH  i  DO  IMF.  SUDOR  JECTIVES  A  DORK  SB  ALL..  FACETS 
OF  HIE  PARENT  OBJECTIVE*'  (Y/N) 

IS  THERE  AMY  OVERLAP  BETWEEN  THE  COVERAGES  8F 
THE  SUBOUJECTIVES*  •W.SriiiPSON?  (Y/N) 


?n 

U.STIMPSON'  are:  ALL  THL-:  S  U  DO  Vi , .!  V.  Cl  f  V  E  3 
-MEANINGFUL  f U  YOU?  Ct/M) 


OPERATIONALLY 


COm..!i  ANY  OF  THE  SUBOBJFCTIVES  i<L  IGNORED 
SI  ON  If-  .f  CAN  i  LY  J  HR  AC  f  INO  T  OUR  PRT.r-TRLNCES » 


H  I  'I  HOOT 
W  f  ST I HP SOM? 


CURRENT  MULDER  Aj  HliAEiiJ  C  ( MAX  GOO) 
CURRENI  NUMBER  01"  L.FVN.S:  2 (MAX  DO) 
CURRENT  NUmsr.P  Ol-  BYCH-.i-i :;J  a  (MAX  59) 
ADDING  DCUNL  I.NKS  IT)  MO  Dr.  « 

I  1 

•ft)  MAXXrtl/L  AEROO;NAhlC  K-.S-TOKMAilCL 


W.GiJHPSUNv  WHAT  .IS  I  HI. 
(USE  NO  MURE  I  MAN  TOO  0 


ML XT  CUkGBJECI !VE? 
t  I 'ARALT  EE  L. I  NILS) 


'iM/>  Hi hj. SO -* J.  >:  Lindr 


PLEASE  CONTINUE 
?  i'i e  r  o d nr i s hi  j.  e  r  o  i' f  o  n?i  m  « : e 
THE  LAST  SUDODJECrrVE.  ENTERED  I St 
TO  MAXI M .1  ILL  II  I  GH  -  ALT  I T  UBtl 


AERODYNAMIC 


:.-vr 


WHICH  IS  KUBOBJECTIVF:  NUMBER  J. 

for  the  objective: 

TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


(Y/N) 
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Vl.STJMPSOMy  WHAT  IS  THE  NEXT  SUUQBJECTIVE? 
(USE  MU  MORE  THAN  TWO  UO  CHARACTER  LINES) 

T  t- o  ii!  s : j  !?i  i  o  1  o  w  3. 1  i  t  :.j  a  g 
PLEASE  CONTINUE 
Y  a  e  r  <j  c!  <_<  rs  i. ; :  v  v  r  (  a  r  m  s  n  c  (.? 

THE  LAST  BUUODJLCTIVE  ENTERED  ISJ 
T  0  MAX  J  M 1 Z  E  L  D IJ  -  A  L  T  J.  i  t  J  D  E 


A  E  R  0  B  Y  N A h  J'  C  P EPI-'Ol J f-'ANC E 


WHICH  1C  SUBOB JECTJVE  NUMBER  2 
FOR  THE  OBJECTIVE; 

TO  MAXIMIZE  AERODYNAMIC  f’ER!  ORMAMCE 


U,BTJHrSOM»  WHAT  IS  THE  NEXT  SUBCBJECT1VE? 
( USE  NO  MORE  THAN  TWO  80  CHARACTER  LIMED 
v 


1  .1. 

®  0  (.» 8  A  I?  0  ( >  8 8  8  W  I  >  V  U  t?  g  0  y  &  i  J  A  (?  y g  (<•  (,)  g  g  g  ®  g  g  ggg  ®  g  y  @  g 

©TO  MAXIMIZE  AERUDYMAM !  C  PERFORMANCE  0 

8  (? 

0  0 

0  (?> 

{?  0  0  O  0  {••'  0  0  0  0  (■!  y  0  (?  00  !:>  R  0  g R  0  0  P  ft  0  fj  0  0  0  0  Q  0  0  0  (3  (.;  (.)  <;•  0 

0  J.  i.  1 

8  0  0  0  0  0 ■  0 L 0  0’  l?  0  0  0  0 1  1  0  8  0  0  0  8  0  9  0  0  0  0  U  0  0  0  9  0  0  0  0'  9  0 • :  ■ 

0  ■  0TO  MAXIMIZE  HIGH-AL1 11 UBE 

y  a 

0  0  0  0  0  0  0  0  0  0  A  r  R  0 !  ( I  U  A !'  < .!:  C  PERFORMANCE: 

0  J? 

0  0  0  0  0  0  0  0  ;»  0  0  0  0  0  0  8  (?  0  0  0  @  0  (3  0  0 13  (3  0  0  0  (3  g  0  {?  0  0  0  ..J  0  >_• 

0  3  J.  2 

.  8.  (3 g  0  0  0  0 0 0 0 0 0 0  0  0  0  0  0 0 0  0 0 0  0 g  0 0 0 0 0 0  g 0 0 0 0 0 0  0 0 1 

fi  STO  .MAXIMIZE  LOW-ALTITUDE 

0  0 

0 8 0 0 8 0 0  0 0 0 PER V- D  V NAM  I C  PERFORMANCE 
0  B 

(<?  0  0  c 0 0  0 0 0 g  0  0  £  ;  0  0  0  0  0  9  0000 0 0 0 0 0 008  8  8  0  8 0  0 8 0 i 


IJ  .STIMPSONi-  00  TliE  SlihuDJEC  !  .1  VLS  A  0  O Kh 
( )  F  T  ri  L  P  A  R  E  f  ■!  T  0  ?■ .  J  E  C  VI ’>  E  ?  (  Y  /  N  ) 


ALL  FACETS 


IS  THERE  ANY  OVERLAP  BETWEEN  THE  COVERAGES  OF 
THE  SUBODJLCTIUES*  W * STIMPSON?  (Y/M) 


w.sTiMrsoN*  are:  all  the:  suuqbjeci  iviis  operationally 

'MEANINGFUL.  TO  'uiiP  *  Y/rP 


could  any  ui'  rnt:  slidolmectivls  be  ignored  without 

SIGN*  I  FI  CAN!  LY  IMPACTfNb  YOUk  PREn:  PENCES  t  M. STIMPSON 


CURREMf  NUMDER  OF  NODES;  7\MAX  500) 
CURRENT  NUMBER  OF  I  LULLS i  3 (MAX  20) 
CURRENT  NUMBER  OF  SYSTEMS?  ‘.i (MAX  5V) 
ADU. I  NO  DOWNLINKS  TO  MODE? 

1  :i  1 

TO  H  A  XEfl.T/i:  1 1 1 U  H  -  ALT  ]  I  U  f<  K 
A  E  R  Oil' Y  N  A  M 1 C  f  *  E  R  F  0  K  M  A  N  C  E 


W  -  S TIME1  SON  *  WHAT  I  S  7  HE  NEXT  SUHOVi  JECTIOE? 
(USE  NO  HOLE  THAN  TWO  BO  CHARACTER  LINES ) 


v 


CURRENT  NUN HER  OF  NODES ?  7 (LAX  SCO) 

C u R I < r. N T  H UI'; A h  R  nr  I  E 0 !:  ).:><*  A ( M A >.  2 0 ) 

CURRENT  NUMBER  OF  S',  SflM-ii  B<hA<  5<>> 
ADDIN'*  JiOWNi  IN  MS  TO  NOW.  ; 
l  1  2 

T  0  MAX }  M  t:  LOW-Ai  .'I  I  fUfiL 

AC ROBY  NAM 3 C  PERT  ORMANCE 


W.SriMPSUH;  WHAT  IS  THE  NEXT  SIJBODJECTIVG? 
( USE  NO  MORE  THAN  TWO  BO  CM  A!:’ ASTER  LINES) 


CURRENT  MUM  HER  01-  NODES!  7  (MAX  000) 
CURRENT  NUMBER  OF  LEVELS  ’>  3  (MAX  20) 
CURRENT  NUMBER  01'  SYS  TENS!  3  (MAX  5?) 
ADDING  DOWNLINKS  JO  MO DC i 
1  2 

TO  MAXIMJ  7F.  A 1. Ri  :R  Al: T  SURVIVABILITY 


W • ST I HP SON r  WHAT  IS  THE  NEXT  SUB OBJECTIVE 
(UHL"  MO  MORE  IT  IAN  TOO  HO  CHARACTER  LI  NEC) 


CURRENT  NUMBER  OF  NODES!  /(MAX  500) 
CURRENT  NUMBER  OF  LEVELS :  3 (MAX  20) 
CURRENT  NUMBER  OF  SYSTEMS:  3 (MAX  5V) 
ADDING  DOWNLINKS  TO  NODE: 

1  3 

TO  OPTIMIZE  MULTI-ROLE  COMBAT 


CAPABILITY 


W *  ST 1 UPSON v  WHAT  IS  THE  NEXT  SUBOBJECTIVE 
(USE  NO  MORE  THAN  1 00  00  CHARACTER  LINES) 
?to  ti!3;:irii j.\.:e  o.i  r-lo'-sw'uuicl  roinbi'l 
PLEASE  CONTINUE 
?ca>'3hil  I  ta 

THE  LAST  SUBOBJECT  I OE  TMJr;RI:.V.i  IS! 

TO  MAXIMIZE  AIK-TO-  GROUND  COMBAT 

CAP  AB I  LI  f'Y 


WHICH  IS  SUBOBJECT. i  V!  NUhRSLR  .1 
FOR  THE  OBJECTIVE; 

(0  OPTIMIZE  MULT.! -ROLE  COMBAT 


CAPABILITY 


u 


W.STIMPSDN-  WHAT  IS  THE  HI. XT  SUBOflUhCTIVE? 
.(USE  NO  MOEH.  THAN  TWO  HO  CHARACTER  LINES) 
?to  rricuciinj  so  ::i  r--to-'!roi.iiid  coKiiral 
PLEASE  CUNT  INUli 
?  u  f  f  p  c  t  i  v  v>  n  <.' t, 

THE  LAST  fUJUOUJHCT  rvt  EN  V  ERF  IT  JSt 
TO  MAXI  M  J.  2 E  A  J  R  -T 0  - G R 0 U N IT  CO H  h A T 


EFFECT  I  UENESS 


which  is  suunrsLCTu-'i::  hum cep  2 

FOR  IS  It  OBJI’L  !  jyiLi 
TO  OPTIMIZE  MULT!  -ROLF  COMBAT 

CAPAL3  LI  I Y 


W .  ST  IMPS  ON  1  UIIAT  JS  TT  IF  NEXT  SUnoUJKCl  IVKT 
(IJSE  NO  MORE  THAN  I  WO  00  CHARACTER  LINES) 
Tto  rti j. m i  v. «  rocc o  c: <3 p a !..> i .!  i.  t «.! 

PLEASE  CON  I'lNl.'F 
v 

THE  LAST  SUDOITJECTIVE  L-.rl'f LEE  IT  I S J 
TO  MAXIMIZE  RECCE  CAPABILITY 


WHICH  13  SUBUBJIiC  HUE  NUMB  I!  R  A 
FOR  THE  OBJECTIVE; 

TO  Gi'TlMIZi.  MUI.T  I.-ROL.E  CO  MR  A I 

capakii.  n  r 


t-J  *  ST  !  fiPSOLN  WHAT  IS  fill 
(USE  NO  MORE  THAN  TVO  ! 
1* 


Nf  XT  SUKOCJH'  HUE  <> 
OHARACi  IT1  i..!  Mlr.S) 
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*  *  - »  '  s'  -  t  ^  t-  ‘  >  *  ^VT1j~, 


u 


[  > 


i  3  •  - 

e  @  (» {?  ©  &  0  e  g  g  g  g  0'  e  e  0  0  g  1?  g  g>  g  0  g  e  g  0  0  0  0  0  0  g  0  0  0  0  0  0  0  0  0 
0TO  OPTIMIZE  MULT  f -KOI. 8!  combai  0 

e  0 

GCAPAI3J  I.T.T'n  0 

0  0 

0  0  g  0  0  0  0  0  0  .?  0  0  0  0  0  0  ()  0  0  0  0  0  0  0  0  0  0  0  0  0  y  0  0  0  (.  0  0  0  0  0  0  0 

0  3.  3  3. 

0  0 0 0 [ ! 0  0  0 0 1|!  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  &  0  0  v 

0  01 U  MAXIM!/!-.  AIR-TO-GROUND  COM)-; A V 

0  0 

0 0  0 0 P 0 0 0 0 0 C  A  P  A  I.-:  [  I  I  CY 
0  0 

0  0 0  0 0  0  0  0  0  0  W  0'  0  0  0  0  0  P  0  (4)  0  0  0  0  0  0  0  0 0  0  0  0  0  (3  0  Gt 0  0  0  LL 

0  3.  3  2 

P  0 0  0 0  0 0  0  0  0  0  0  0  0  0  0  0  0  0  0)  01 0  0  0 0 0  (;1 0  0  0  0  0  0  0  0  0 0  0  2 1.1 

P  PTC)  MAX  !  h  t  ZE  ALK“1G-(if<OUNLl  COMBAT 

0  0 

P00000P0G)0l;  it  !•:(.")  iah-  ncss 
0  0 

P  0  P  (•'  0  0  P  0  0  0 0  0 0  0  0  (|  ■  G  0  0 0  0  0 Q  0  G  0  0 0  0 0 0 0  0 0  0  0  0  0  0  P '  ■ 

0  3  3  3 

0  0  P  P  0  0  0  P  P  P  P  i « P  0  0  ©  G  P  0  0  Q  P  0  0  0  (» (2  0  0  0 0  P  0 0 0 0 0  0 P  P ! 

0  01  0  MAX  I  MJ  7.E  RECCE  CAPABILITY 

P  1;) 

P 00 000 0000 
0  P 

0  (V) 0 00 0  0  '  0  0  0  0  (<)  0  0  0  (.1  000  (!)  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  0  00'  '0 

W  .  BIT.  MI 'BON  y  BO  THE  CMBOB  Ji-S -T  !"PI..O  AOuRKBS  A).!..  FACETS 
OF  THE  FAIvLH  I  OBJEX  CXVl-.Y  C  Y/.j ; 


YOU  nick  MOO  MOUi Lr  I.Nb  Hil  |  REE  , 

E" MTt-IM  ,  ,  .  MR  MY .1. 

3 

3. 

0 

E  N  T  t- 1  '<  Y  0  U I  <  S  U  B  \  l  h  J  l  C  I  3  V  V 

!  Lo  rfc*£X.i  ill  i.  „\t.»  t.l  1  i '  L O  <*'  .1  ('  CCiulltJ  b 
PLEASE  LUNNXOi. 

Toffee  Lx  vci  i 


ENTER  *  .  .NSOJVO 


‘  .V* 


1 


(» (3  (3  ft  &  (3  {3  0  (3  (3  ( 1 13  ft  0  (,  >  ft  ft  (3  0  0  p  0  1,1  (,)  0  0  (3  Q)  (,i  (3 1.)  (,)  p  ft  ft  p .  .  0  ft  0  0  g 

pto  nnmi/F  nun  ! ~fcoi. s-:  oumbai  § 

e  0 

GCAPAB'J  LI  fY  0 

0  0 

0  0  0  G> 0  0  {"  0  0  0  O'  (:'  1 !  0  (•* 0  (.*■'“  ft  0  0  0  0  ( .'0  00  0 !  ’  0 ft  0  ft  0  0  3'  0 0  0 

0  1  .5  !. 

0  0  0  0  0  0  0  0  0  0  0  W  0  0  0  0  0  ft  0  0  ft  0 0 0  0 0 (3  f»  G  0  ft  0  0  0  f  ?  C?  0  0  0  0 0.  • 

0  010  AMX ! 0 1  'L  AJFi-TO-ATR  COMBAT 


(;r  0  0 0  0 0  0 0 0  0 1 i  •  f-  IXT.E  VfNEISS 
!:'  0 

0  0 0 0 (,) 0  0  (,•  0  0 00  0  0 0  0  0  0  0  0  0  0  0  0  0  0 0  0  0  0  0 0  0  0 0  0 0  0  0  0  0 . 

0  J.  J>  0 

0  0 0 p 0 pp 0p (,< 000 0 0 {•' 0 0 0 p 0 0 p p 0 0 (3 o (» (i? p (3 P (3 (3 (3 (3 (3 ft  ( ■  ■  ■ 

0  ero  MAXitu/t:  air-to-ground  combat 

ft  0 

000t'‘O0O?000Fr  IT:  C  <  I  UQfFSS 
ft  03 

0  0 0 0  0 0  0  0 0  0 0  0  0  0  0 0  0  0  0 0  0  0  0 0  0 0 0  0 0  (3  (3 0  0 0  0  0  0 0  (3  p  • ,  • , 

ft  J.  6  S 

0  0’  0  (>>  0  0  0  v '  !•.'  ft  p  >3 O'  (3  (3  ft  (3  03  (3  ft  0.’  (3  (3  (3  '3  (3  (3 13  (3  03  (3  ft  ft  (3  G3  (3  0  0  0  0  ■ 

(3  ft  TO  MAX  I  A. I  /.!•.  |?LCC£  CAPABILITY 

0/  0 


(j)  (/)  p  0  0  (3  (/*  0  0  0 

O'  (3 

ft  (.-'  ft  13  0?  0  ft  ft  l  ‘  (3  0  (3  ft  (3  ft  ft  0?  (3  (3  (3 13  G 13  ft  (3  (3  (3  !3  ft  ( ?  ft  (3  (3  !i?  (.3  C3  (3  (3  (3  O'  • 


W.S’NMi'riOM.  1.10  TMC:  IS.CTIW*  AUUliKsjf}  ALL  FACETS 

of  Tiny  paw.  mi  OB.it.c r roi-..?  ovn> 


IS  1 !  IFK! :  A  NY  OOFRFAP  B:X  rt-ii!!  !M  I  lift  cnVi-.KiiUil*.  OF 
'i  ill'  SUBOB J!. U  I  i:  Vl'.C  f  W  ,  i>T  l hi' BUM?  (,  Y/fJ ) 

?  n 


W,'.;riMPSOM»  ABF  AJ.L.  7I!!£  SUBOBJECriVFS  U  T-'  IX  OAT  I  OH  ALLY 
KFhMINuRJ!  fO  YOU-’  <Y/M) 


OOUI.U  ANY  OF  TrlF  MkiOBJKC'l  i  01  .£»  Fi.:  i  ift'OMl.O  W.l  I'HOUT 

SJONJF  JCAMILY  i  WAO  I' .1  MB  I'ulJI':  1 'IT  I  l  Fi- W  ♦  ST.'l'MPSON?  <Y/M) 


m 


CURRENT  MUMHl.R  UK  MQ1.H:7>:  .UXH«iX  -jOO) 
CURRENT  NUMBER  Of  !...!.  OKI  f>J  XfriAX  20  > 
GURR£N«'  NUiJRJER  UF  BYS'lLAS?  3 (MAX  59) 
ABO  IN>‘.  ImWMl.fNKS  (0  NOl'K.i 
.1  3  .1. 

((•;  MAXIMA/.F.  AJ.!':-il)"iVlli  COMMA  I 
FJ-  FEGTTVrNtGG 


W  US  T.L  MI-CON/  Wi  I  AT  3  S  fl-ir  NH'XK  CUBOBJi.C'f  JVK.  i' 
<  USE  MO  MOKE:'.  3  HAM  TWO  BO  CHARAC'l  K LINKS) 


CUR’-EN f  N1  INKER  OK  MOEilTU  .1.0 (MAX  500) 
CURRENT  NUMBER  Ul-  LEVELS;  3  (MAX  20) 

CURRENT  NUMBER  01-  Si' E-SIT.  MSI  3<MA\  5V) 

AiU.iJ.HU  no  UNLINKS  10  HOOK : 

i  jr  2 

•|U  !'lAXJ.fi:i7.r.  A  IT"  TO-  GROUND  COME: A I 
i:r-  l  o  i  .i.vT'.i?f:ru; 

M,sur.i:i!,  ui !A i  is  inr  m-x'i  sunn;.i!  iu  n'f-‘ 

(l:*r  NO  !  iili-’i .  IMAM  TWO  SO  (X  (ARAL  i  I  K  I  M'isn 


Cur'd'.;!;-  M  !  NUMBi.k  '-V  NOOi.  {.*  TO (MAX  50 <»} 
CURRENT  ilUr.BEf;  01"  UT'i.l  ‘,i  5<NAx  20) 
CURRENT  MUM  BE: R  01  ‘  ES't  L  I  i:TiE>  S  3 -TAX  59.’ 
AIU.iJ.HU  /JOIJMUNKS  fO  MOT-U 
,L  o 

TO  MAXJ.rU/IL  Ul-.U'E  CftPrthJUTY 


W  .  SI  J  NITON  ■>  WHAT  IL  Sill"  Ni.X:  SIH'OI:  JEC  I  I  0!.-. 
(USiV  NO  MOlT.  II -IAN  (WO  00  OH  ARAL  I  IN-:  U  MIXES  > 


CURRENT  NUMBER  OF  NUDES :  10  <  MAM  MOOT 
■CURRENT  NUMBER  OF  LEVELS  I  3  ( MAX  VO  ) 
CURRENT  NUMRFR  0I:  SYSTEMS.1  3  (MAX  f,9) 


W  .  ST IMPS ON  y  PLEASE  INPUT  AM  A  I  YR  IBU  ('!•■.  TOR 
THE  II  AT  A  NTiL'.l !  WJL1H  THE  OBJ  EC  5  !  VL  J 
TO  MAXIMIZE  M  !G! !  ALU  Hi  Ilf.' 

AERODYNAM 1 0  !  TIN-  ORHANCF. 

(10  LETTERS  OR  I  I' SO 
YIuDh-ise  ro 

IS  THE  ATTRIBUTE  HIGH-AFRO 
SUCH  "(HAT  BY  KNOW  INI)  IT'S  I.EViT  t 
T I  IF  AT  TA 'LUMEN  I  OR  THE  ORJEC  I  i.  VL 
I S  T 0  I  A U . Y  IT l  "i  1:R  ' 1  Ml:'. li ■‘t  <  V / N ) 

COUL  1 1  Till!  ATTRIBUTE  t ITCH-  ACRO 
BE  CISAMOEO  SO  AS  Vu  TMPROVI 
COMMON  I.CAP. NO  til! A  i  iS  .ihP!  J  LB 
IN  Till-  OBJECT  J.VRY  (  Y/il) 

Yn 

WHAT  IS  TH!i  WORST  ACCEPT  AST  L 
LEVEL.  (REAL  HUMBER)  OF  II I  i)i  1-. il:T':0 
?0 

THE  LEVEL  STORED  WAS  0. 

WHAT  IS  THE  BEST  ( RE ALLS  TIC ALLY ) 

LEVEL  (REAL  NUMBER:)  OE  HIGH-AERO  »  W.STLF. 
?10 

THE  LEVEL  STORED  WAS  1.0, 

W ,  ST  IMP  SON  v  PLEAS!:  INPUT  AN  AT  TR'TBU  { K  EUR 

■the  data  nude:  uiTii  n;...  objeci ivi.t 

TO  MAUM'.I  XL  )  .OW -AL  5 ITUDE 
AERODYNAM  I  C  PERI- URMANCK 
(JO  LEI  TERR  J 


IS  THE  AH' RL2.1t IT  E  LOU-AERO 
SUCH  THAT  2.1  Y  K MOWING  .ITS  LEVEL v 
THE  ATTAINMENT  OF  THE  OBJECTIVE 
IS  TOTALLY  DETER HIM KB?  (Y/N) 


COULD  I  HE  AT  TRIBUTE  LOW -AERO 
BE  ClIAi'Lil:  D  SO  AS  (0  [MI-ROVE 
COMM1  If !J  CAT  .[MO  WIIAI  IS  !  HIM  I' ED 
IN  THF  OBJECTIVE!1  (  Y/N ) 

'•’it 

what  3 ins  worst  accept able 

LEVEL  < REAL  NUMBER?  OF  LOL'-ALRO 
VO 

THE  LEVEL  SI  OKED  WAS  0. 


WHAT  IS  THE  BI'SI  (REALISTICALLY) 
l.EVEi  <  REAL  NUMBER  1  OF  LoW-ACRO  ?  W  *  3  f  1  MESON 
V  .1. 0 

THE  LEW:.!.  STORED  WAS  .1.0, 


W  *  S I  JMP\*ON  r  FT.  LAST 
THE  DATA  NO  or.  Wl.  ill 
TO  MAX.!  hi 7. Li  AJ.RCRA 


EKT'J'f  AM  A  I  T  I?  i  00  1  L 

Hi!.  o.o..!eci  m:t 

I  1  SURVIVABILITY  • 


FOR 


(JO 


LET  I  LLS 
?r-l-  :i  1 3. 


OR  I.  ESS) 


JS  T  HE  AHR'I  ulJTi.  RKiLL 
SUCH  )  1 1 A  f  H  <  ENOW  I.  NO  ITS  LEVEL# 
THE  AT  TAT  NMEN  I  OF'  HIE  OBJECT  j  VE 
13  TOTALLY  BE  TEidLi  NE  0?  (Y/N> 


COULD  THE  ATTRIBUTE  EK.I.LL 
BE  CHANCED  SO  AS  ID  I.  MR  I  MTV!'. 
COMMON  i'  CAT  !  NO  Ml  I  AT  I  S  J  MPL 3!  ED 
3N  THE  OBJECTIVE'!'  (Y/N) 


W  ♦  S'T  IMPS  UN  •/  FT.  EASE  INPUT  AN  AT  TR  T  BO!  E  FOR 
THE  DATA  NODE  WITH  !  Hi!'  OB.IFCTIVE: 

TO  MAXIMIZE  AIRCRAFT  SURV'I  VAB  i.L  i.  TY 


<  J.O 


LEI  ILLS  >A' 
Vvi  1 1 1 1  tv  i 


IS  THE  ATTRIBUTE  VULNER 
SUCH  ri-IAT  BY  KNOWING  ITS  LEVEL.* 
THE  A'fTAJHhENl  Oi'  THE  OBJECTIVE 
IS  EG  TALL  i  OErERMINEU?  ( V/H) 


COULD  THE  AT  TUI  ftlH  E  UUI.UER 
BIX  CHANGED  Y.0  AS  iTi  TilPRO'*!- 
COMMON  I  CA'I  I  N'T  UliAl  !'G  rhPl.IEP 
3  N  THE  OB  Ji  C  t  !  OL  Y  \\'U) 
n 

WHAT  IS  )!!!•.  WO  kb!  ACCi:  I '  I  ABLE 
LEVI !L  ( Mi.  Al .  HOflBLIO  n|  OULNIK 
?.! 

CHE  LEVEL  SIOki  B  WfYJ  1  * 


Ol  I  Al  3  S  ill!.  B|.  si  <  RE  Al  1  SI  !.  I .  Al. !  Y  » 
LEVEL  <1:1-  A! .  MUMBLE)  ()!•  VUI  HI  R 
?0 

me  LlYv’I'.l.  STORE fi  HAS  O. 


W  ,  SI  J.  Ml- ‘SOM'? 


W .  STJ.  MB  SOM  t  E!  .EOS!:  .!  {‘TUT  AN  A  i' !  i‘  J  BO  IF 
THE  BATA  NODE  WJ.TH  I  Hr.  Cns.lFCT  i  VI-,  t 
T  U  M  A  X  :i  M  J.  7  L  A 1 1 « -  •  ll ) - 1 3  3. 1 :  L  U  MB  A  i 


FOR 


I  r  I."  r_- 


FCTIVENESS 


UO  LCniXRS  UR  LOSS  > 

Y a  L  r-rji  r 

IS  lilt.  ATlRIl'Uft  Aili-ATE 
SUCH  1 1 1  AT  BY  KNOW  IMG  .1. 1  f,  I  .EVER  , 
Till-:  ATT  AT  WHEN  l‘  Or  Hi*.  OUJEC  H"E 
IQ  TOTALLY  DOLKM.I  NEBY  O/M) 


could  the  AimieuTi:  ATE- Aik 

BE  CHANGED  SO  AS  10  I  MI^KO*  'K 
COMMON  3  OA  f  IMS  OH  A  I  IS  'i.l-‘l  ic.d 
IN  THE  OBJLOV.iA'L?  <Y/N) 

?n 

WHAT  IB  THE  WORST  ACC! *  (A;-:!.  E 
I ..  E  V  LL  ( kL  A I ..  i  i  UH  B  E  E )  U  I-'  A  I.  R  -  A  f  R 
Y1 

THE  LEVEL  STORED  WmR  I, 


ill1 1 a  i  is  n ir.:  best  < realt s  i  i  cai ,i  v > 

LEVEL  ( HE  A!  NUMBER)  01'  AIR  Aik 


U.Sn.  MASON? 


THE  LEA'LL  Sl'ORI.E  WAS  0. 
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U  i  STIMr'SON  i  PLEASE  INPUT  AN  ATTRIBUTE  !rOR 
THE  DATA  NODE  WITH  THE  OBJEO  HAM-.  I 
•TO  MAXIMIZE  A.1R-  TO  -(.ii'vOUNn  OOMBAI 


EFFECT TURNERS 

<  10  LETTERS  UP  !  FHS) 

~  j  r --'I  round 

:is  THE  AHRIHUiY  AIR-T-ROUND 
StJCI !  I  HA  I  TV  KNOW  !.  MG  1. 1 S  I. !  V!':  i .  » 
THE  AT  I AIN MEN  I  Oi  Hil:  OBJFC  f  LUE 
IS  TOTAL!  s  iJEfEisiiiiNFTA'  (Y/N) 


COUl.Ji  mi-.  AT  T  A;  i  BO'fi.-  A.1.E--UK01W 
BE  CHANGED  SO  AS  Hi  IMPROVE 
COMMl iN T  OAT  I. NS  W!  i A  1  i  H  !  HFL  J QT 
IN  THE  OBJI-C  i  I  UE'-'  HVN> 

?n 

WITAT  IS  THE  WORST  ACOERTABI  E 
I. EVEL.  (REAL  NUMBER)  OF  A  I.K  -GK'OUi f 0 
?i 

THE  I  .EVEL  ST  OREO  WAS  3. 

WIT  A  i  IS  THL  BEST  ( REAL  I.ST  I  LA!  .1.  V  > 
LEVEL  (REA!..  ROLLER )  Of  AIR  •GROUND, 
T  5 

THE  LEVEL  ST  OKI.  U  WAS  0, 

WH-r  iMPSOH-,  IT  KARL"  INPUT  AM  ATTRiri 
THf:  BATA  NOD*  WITH  H  IF.  OB.Ii'  i  ’  I  !'Vi\  J 


iHsrr.ni 


10  MAX  .1  K  I!  I E  RLE 01".  SARA 


T  < 


(10  I  .LITERS  OK  I.I.SS) 
?  room 


IS  f  i  IK  A  HR!  BOH-  i  Ri  CL 
SOCK  IliAf  «T  i.NOO :  (!0  !  ] 
THE  AITAJ.NMi-.iH  OF  /HE  0 
IS  TOT  AI.I..Y  BKTEI.'i'ilNL.BV 
V  y 


1  FUN..  ■ 

Jr  0  !  i  V! 

<  )'/  N ) 


COULD  THE  ATTRIBUTE  RECCE 
BE  0 HANOI.  D  SO  nS  TO  IMPROVE 

co  mm  un  i:cat:i  no  hi  hi  is  implied 

IN  THE  0BJI..C1  LVET  (Y/N) 

?n 

WHO!  IS  Till:  WORST  ACCIPTABIi. 

I.  LULL  (Ki.A!  HlBuilO  Oi-  KL-.i  Si- 


69 


WHAT  IS  1  HE  BE, ST  (REALISTICALLY) 

LEVEL  (REAL  NUMBER  >  OF  RECCE  ,  W,  S  I  I  HP  SDN' 


-4\ 


THE  LEVEL.  STORED  WAS  5. 
HIGU--A!i'RO  I..OW-Al:  RU  VULNER 
AIR-GROUND  RECCE 


AIR- A IK 


THE  ABOVE  IS  THE  CURRENT  SET  OF  ATTRIBUTES y  W , BTIMPSON < 
IF  YOU  SEE  ANY  WHICH  A  Hi"  RFOUMDAM  I  ;  OR 
WHICH  l!AVi-  A  \iTRECT  IMPACT  OH  ONE  ANOTHER 
< L  .  G  ,  WEIGH  !  AND  THRUST)  * 

TOO  SHOULD  REFORM  HIE  AVI  k!  (.UHL-  GET  TO 
REMOVE  TilLTL  PR06LIHS. 

DO  YOU  WISH  TCI  RL':  OkM  THE  A'i  1  RTBU  I  L  GET?  W  ,  ST  IMI-'SGfV1’ 
<Y/M)  Vn 

IIG  YOU  WISH  TO  DYLASS  JH'ilTKNUL’NCL  I  LG  I  I'NGYn 

A I  WHAT  T  01. .FRAN  CL  DO  YOU  WANT  TO  CHICK  YOUR 
RESPONSES  ■/  W »  B  I  IMPUGN  (PLUS  OK  MINUS  X  PERCENT  >  ? 

X-Y02 

WE  ARE  WORKING  AI  PLUS  UK'  MINUS  2  KLRCEM  T  , 

SUPPOSE  I  HAT  1HL  FOLLOWING 
ATTRIBUTES  ARE  AI  THESE  LEVELS! 

VLJLMER  •" .  '/'d 
AIR -AIR  -V, 

Aik -GROUND:-?, 

RECCE  -  =••?  , 

I  HAT  j.S  A I  THE  20  PERCENT  LEVEL. 

NOW  SUPPOSE  THAT  YOU  HAVE  IMF  INITIAL  CONDITIONS S 

II  I.  GIT-fil:  HO  -•'•’J .  AND  LOW -AERO  G. 

IMAGINE  THAT  LOW -A FRO  IS  Cl lANGED  10  2. 

WHAT  LEVEL  OF  H J  OH-AERO  WOUI..D  Kfc.F i:‘  YOU  .AH  SATISFIED 
AS  YOU  WERE  UNDER  THE  I  ill  VIAL  CGNDT  VIONSY 
(REMEMBER  THAT  ALI  Ol'IILk  A  I  i  R  j  BUI  L  U  ARE  nT 
THE  21"  PERRIN  I  LEVEL  ) 

?7 


SUPPOSE  THAT  YOU  ARE  H  TAT?  TING  A I 
•HIGH-AERO  -’.j,  AMD  L0W--AFPO  ■G. 

IMAGINE  THAT  S.  IN  I.OW-AERO  IB  ACHIEVED, 

TO  WIIAT  LEVEL  WOULD  YOU  CHANGE  IIIOH-AERO  »  IN  ORDER  TO 
REMAIN  AS  BAf  TSF  JL  D  AS  YOU  WERE  IN  I  I  TALLY'? 

(REMEMBER  THAT  ALL.  Wl-ILK  A  H  RIP!  !'i  EG  ALL  AT  THE 
22  PERCE N I  LEVEL) 
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W.'Kf  JMPBON.  GtlRPOBi?.  MOW  THAI  I  HE  FOLLOWING  AT  f  RIBUT ELS 
ARE  Sllir  1  h  D  TO  1  i  SLSt  L  EVEL  8  : 

VULNEK  •■  v  1.:’.; 

AIR  A  i. I*.'  =  4  < 

AIR- GROUND =4 . 

RECCE  :~4. 

THAI  IB  A I  HIE  75  PERCENT  I.E.VLI. 

SUPPGCK  THAT  YOU  HAVE 
HIBH--AER9  AND  LOU-  AERO  =4'j . 

IMAGINE  l HAT  I HE  LEVEL  OF  LOW-AERO 
is  changed  to  :■>«» 

WOULD  THE  LEVEL.  Olr  HIGH- AERO  NHL-DI-'O  TO  REMAIN 

ac  satisfied  as  at  the  initial  condi i ions 

LIE  BETWEEN  7.1  AND  a.V 
(  Y  /  N )  •?  >/ 

SURE' USE  THAT  YOU  IlftVF:  THE  INITIAL  CONDITIONS 
HIGH- AERO  -5  *  AND  LOW  -AERO  -'A  * 

IMAGINE  THAI  vOU  HUS  f  Af.CER  f 
A  LEVEL  01-  ii,  IN  LOW  -A S'. KO  . 

WOULD  THE  LEVEL  01-  H  I. OIL  -AERO 

THAT  YOU  WOULD  H  -sVC  TO  HOOK  (0  (  EM  ORDER  TJ  BE  AS 
SATIS!- 1.1. D  AS  ON D;:. K  V HE  INI  VIAL  CONi.j.  T  TUNS)  LIE 
BETWi: EH  2,1  AMD  3  .V 
(Y/N) 

THERE  ALT'  MO  1A?HI !!  'L* NDLiTCT  '  I-' ROB!  I  OB 
WITH  7  Hr.  AT  ITJ  B’JTL  G  HLSVED  GO  WAR , 

BO  YOU  WISH  10  ASSUME  I *i*  L  K»K  HIE 
K E M A  J  H  F N 0  A  I'  I ! \  l  h U TE  S  ='  ( V  / N ) 

’i'n 

EVEN  IF  YOU  DO  HOT  WISH  ft;  ASSUME 
PR  I  AMONG  THY.  REMAINS  AT  VRJRUTES v 
BO  YOU  WANT  TO  STOP  REA  !  [•STINGY  (Y/N) 


suppose  nidi  niE  ltd  i.  owing 

AT VRI DUCES  API-  (W  nil.SK  l.FVi-IB: 
LOU- AERO  ■? ,  L- 
AIR- AJ  E  -=2 
AIR-OKOUND-G;, 

.RECCE  -2. 

THAT  18  AC  THE  25  PERCENT  LEVEL 


.NOW  BURrOSE  l  HAT  YOU  HAVr  THE  INITIAL  CONDITIONS: 
HIGH  -AERO  ~L.  AMD  VOL  NCR ’  - .  L" 
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IMAGINE  THAI  V ULMER  13  CHANGED  TO  .2 

WHAT  LEVEL  OF  HIGH- A LEO  MOULD  KEEP  YOU  AS  SATISFIED 

AS  YOU  WERE  UNDER  HIE  INITIAL  COMD ! T IONS? 

(REMEMBER  THAT  ALL  OTH‘‘R  ATTRIBUTES  ARE  AT 
THE  2 If)  PERCENT  LEVEL ) 


SUPPOSE  THAT  YOU  ARE  STARTING  AT 
H I  Oil- AERO  "Si.  AND  VUI.. MLR  '.5 

IMAGINE  III  A  I'  .8  .'IN  VULNLR  IS  ACHIEVED. 

TO  UHAT  LEV  FI  WOULD  YOU  CHANGE  H  IGITAEKO  IN  ORDER  TO 
REMAIN  AS  SATIHP  LED  AS  YOU  WhllE  INITIALLY  T 
( Ri  OSH  MGER  THAI'  ALL  OJ'IIER  ATI  RX DOTES  ARE  A  I  THE 
2 Si  i  'EftCF.N  I  I...KVI:  I.. ) 
vy 

M.STIMPSON/  SUPPOSE  MUM  Tl-in'f  THE  FOLLOWING  ATTRIBUTES 
ARE  SHIRR'D  fO  THESE  LEVELS 5 
I..OW-AI:.RO  ••••/,:> 

AIR-AIR' 

AIR-GROUND- -T  . 

RECCE 

III  A  I  IS  A  I  THE  /O  PE  ICC  I  N  J  LEVEL 

SUPPOSE  THAI  YOU  I  If  i  VP 

HIGH  AI-.RO  "Si.  AND  VULNi  If  Va 

TiiAOJ  NE  THAI  I  Hh  i.KVLI.  f«i  VULNER 
£S  CHANGED  Id  ,2, 

WOULD  5  nr  LEVEL  Of  high  AERO  MELDED  fO  REMAIN 
AS  SAlISRL-U  AC  A  l  !  I  IE  JNiSl.AI.  CONDI  I  IONS 
l.JE  PI.  LULL  N  C .  I.  nND 
( Y/N) 

SUPPOSE  THAI  YOU  HAVE  i!!h  INDIA!..  CONDITIONS 
HIGH-AFRO  -C.  AND  VULNLR  ~ .  U 

IMAGINE  THAT  ;'OU  f'UCT  ACCEPT 
A  LEVEL  OF  ,3  IN  VULNLR 
WOULD  THE  LEVEL  U!  UIO! i~ AERO 

IliAi  YOU  WOULD  HAVE  J  0  MOVE  TO  (IN  ORDER  70  BE.  AO 
SATISFIED  AS  UNDER  fill-'  INiVTAI.  CONDITIONS)  LIE 
PFTW'-EN  9,  I  AND  H  .  V 
(Y/N)  ?.j 

THERE  ARE  HO  INDEPENDENCE'  PROBLEMS 
WITH  THE  rtTH'::  RU  i'ES  I  EC  I  ED  SO  PAR, 

DO  YOU  WISH  ro  ACC! IMF  IT!  ! 'OR  THE 

R  c  M  A  I'  N  r  N  n  A  T  !  '  R  I  D 1 1 7  F .  C  i  1 Y  /  N ) 
y  t .» 
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(life 

jg£  WHAT  LEVEL  OF  1 1 1 Gil- -A  FRO 

WOUI-1.I  BE  OUCII  THAT  YOU  WOULD  FEEL  THE  SAUL 
.AMOUNT  OF  CHANGE  IN  Sf-iTTSFACT  TON  EH  MOVING 
FROM  0.  TO  IT?  AS  FROM  THAT  LEVEL  TO  10.? 


WHAT  LEVEL.  OF  HIGH -A  ERG 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  .IN  3A  M>Si~  fiC'5  J  ON  IN  MOV:  NO 
FROM  0.  TO  IT i  AS  FROM  f HAT  L.EVFL  TO  b»? 

?3 


WliAT  LEVEL  OF  HIGH -AERO 

WOULD  BE  OUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SAT  J Sf  ACT  TON  I  N  MOVING 
FROM  10.  10  IT?  AS  FROM  THAT  LEVEL  TO  U.Y 
?? 


(  « 


THE  ABOVE  YIELDS  A  VALUE  FUNCTION  FOR'  HIGH- 
WITH  IMARAMETFRS J 

DO--  •• ,  03  724  I 37V33.A3S  Cl  =•• .  1 03-; 4 0070062 1 

SUM  OF  SQUARED  ERROR-1  ♦  004310344827036 
t LINEAR  FORM ) 

VAL.IJE  -BOLDIN  (  A  VTRJ.  DOT  I".  LEVEL. ) 


TIRO 


3  0.00 


8.00 


T 

.}. 

+ 

■ 

+ 


i.50 


I 

...1. 

I 

J. 

> 

-I- 

+ 

X 

I 

..1. 


50 


•F 

I 

V 


# 

% 

-  % 

+ . . 

0 . 0 
VALUE 


I-  - 
.5 


-+- 


- 1 

3 


VALUE  FUNCTION  FOR  111011  AFRO 
O  DOES  HI!:  ADO VL  Ri‘ p:  'T  , 1  <  ••  i  »  ON  Ar  =  'E(.F  OLAi-.M. 
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i 


I..DLE?  (Y /it) 


WHAT  LEVEL  OF  LOW-- AERO 

WOULD  BE!  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOOT. MB 
FROM,  0,  TO  IT..  AS  FROM.  THAT  LEVEL  TO  10.? 
TS 

WHAT  LEVEL  OF  LOW-AFRO 

would  bE  such  That  you  would  feel  the  same 

:  AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  0.  ro  Its-  AS  FROM  THAT  LEVEL  SO  3.? 

?2 

■WHAT  LEVEL  OF  LOW-AERO 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE.  IN  SATISFACTION1  IN  MOVING 
FROM  TO..  TO  IT#  AS-  FROM  THAT  LEVEL  TO  3:.? 
?5 


DOES  THE  ABOVE  REPRESENTATION  APPEAR  RE  A  SON  A  IT 


WHAT  LEVEL  OF  Will.. HER 

WOULD  BE  SUCH;  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATXSf- ACTION  IN  MOVING 
FROM  1.  TO  IT?  AS  FROM  THAT  LEVEL,  TO  6,.? 
?,2S 

WHAT  LEVEL.  OF  VULNER 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  1*  TO  IT i  AS  FROM  In AT  LEVEL  TO  *25? 
?*J. 

>1  IS  OUTSIDE  THE  RANGE  OF  1,  TO  .25 
'WHAT,  LEVEL  OF  VULNER 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM-  1.  TO  IT?  AS  FROM  THAT  LEVEL  TO  *25? 

o  r.* 

.  !  »  vJ 


WHAT  LEVEL  OF  VULNER 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  0*  TO  IT?  AS  FROM  THAT  LEVEL  TO  *25? 

? .  1 


THE  ABOVE  if J ELDS  A  VALUE  FUNCTION  FOR  VULNER 
.WITH  PARAMETERS  J 

B0*1 .023191314901  Bl=-1  *03670620:108 

SUM  OF  BOUAREI.i  ERROR" .  005340224256907 
>  <  SQUARE' --ROOT  FURM) 

VALUE=B05 61* (ATTRIBUTE  LEVEL >*# *5 
6.00  •-•!• 


.20 


.45 


'  *70- 


..95 


+ 

+ 

+ 

-+ 

a. 


y 

“  i* 

+ 

+ 

.1. 

» 

.i. 

i 


* 


* 


* 


* 


* 


i 
I- 

+  * 

+  # 

-+# 

0 . 0 
VALUE 


. 


t< 


.  75 


75 


i 


■0ALUE  FUNCTION 

:iiQiis  The  at  cue 


FOR  VULMER 

» 

REPRESENTATION  APPEAR  REASONABLE?  <Y/N> 


WHAT  LEVEL  Of  AIR-AIR 

•WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SANE 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  1.  TO  IT?  AS  FROM  THAT  LEVEL  TO  5.? 


WHAT  LEVEL  OF  AIR-AIR 

WOULD  BE  SUCH  THAT  YOU  WOULD  .FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  1 .  TO  T T .•  AS  FROM  THAT  LEVEL  TO  3.5? 
?3 

WHAT  LEVEL  OF  AIR-AIR 

WOULD  BE  SUCH  MloT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SAT I SF AC i ION  IN  MOVING 
FROM  5.  TO  IT y  AS  FROM  THAT  LEVEL  TU  3.5? 
*?4w  5 


THE  ABOVE  YIELDS  A  VALUE  FUNCTION  FOR  AIR- AIR 
WITH  PARAME'I  EPS  \ 

BO*-. 06190727081 J 30  Bl« . 04162276030084 

SUM-  OF  SQUARED  ERROR- .  COS 4 6 205 56 37 5 13 
(SQUARED  FORM) 

V A L U E •- B 0 -i- B .1. :I< (ATTRIBUTE  I  E V E I... ) :* # ? 


5.00 


4.20 


••••( 


r 
+  • 

+ 


* 


; .  20  ■ 


2.20 


1.20 


I- 

+ 

T 

■f 
-I 
+ 
i 
+ 
+* 
•+* 

0 . 


5fc 


* 


55: 


1. 
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value;  function  for  air- air 


•  **<*<*  S  *  S’  .MJ*  -f*  •* UV"  » 


VALUE  FUNCTION  FOX  A  IP: -GROUND 


i  <1 


'.51 


til 


DOFS  THE  ABOVE  REPRESENTATION  APPEAR  REASONABLE?  <Y/M) 
?y  ,  . 


WHAT  LEVEL  OF  RECCE 

WOULD  BE  SUCH  THAI'  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM'  U  TO  IT »  AS  FROM  THAT  LEVEL  TO  5.? 


WIIAT  LEVEL  OF  RECCE  ' 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  1.  TO  IT  *  AS  FROM  THAT  LEVEL  TO  2.5? 


WHAT  LEVEL  OF  RECCE 

WOULD  BE  SUCH  THAT  YOU  WOULD  FEEL  THE  SAME 
AMOUNT  OF  CHANGE  IN  SATISFACTION  IN  MOVING 
FROM  5.  TO  XTt  AS  FROM  THAT  LEVEL  TO  2. >5? 
v  4 

THE  ABOVE  YIELDS  A  VALUE  FUNCTION  FOR  RECCI 
WITH  PARAMETERS l 

BO™-' . 02654A0233373  Bl<= .  80578:19694028 
SUM  OF  SQUARED  ERROR™. 008995310047.1.34 
(SQUARE -ROOT  FORM) 

V  A  I.  U  E  --  BO!-  B 1  &  <  A  r  TRIBUTE  LEVEL )  *# .  S 


‘VALUE  FUNCTION  FOR  RECCE. 

DDES  THE  ABOVE  REPRESENTATION  APPEAR  RFA80NABL.E?  (T/N) 

fy  ", 

OPENiNB  FILE  NUMBER  1 

IS  THIS  DATA  NEU  (NX  OR  STORED  (S)?s 


W .  ST  I  HP  SON  •>  YOUR  OPT  IONS  ARE  : 

ATI  COP  DIS  DON  MOD  NEW  MUM  PRU  RED  SKL 
SEN  SPA  STA  SYS  TTL  WDC 

***NO-TEi  IF  YOU  NEED  AN  ‘EXPLANATION j  W.STIMPSON 
TYPE  “HELP"  *>:<>!: 

'i 

WliA.T  IS  YOUR  CHOICE  t  U  ,  ST  IMPS  ON?  rev 


HOW  MUCH  DO  YOU  MAN V  10  REVIEW. ♦♦ 

A  (  LL  S (ELECT 

•  ?* 

IF  AMY  rtOinrj  CATIONS  HADE  DEEM  MADE  TO  THE  T  ft  Eli 
SINCE  IT  HAS  BEEN  CALCULATED  ?  NUilEK  I  CAL  DALUES 
■WILL  BE  INCORRECT 4 
(PRESS  ANY  LETTER  TO  CONTINUE) 

?  d 


THIS  EXAMPLE  IS  IP TENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM;.  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED >  <  ALL  PRE E t RENCES  AND  DALUES  ARE  HYPOTHETICAL 
WAYNE  At  HT I  Mi  P  SOM  19  NOD  J9ftJ 

1  ' 

TO  OBTAIN  THE  BEST  '''AVAILABLE  PLANE 

i 

FOR  FORWARD  DEPLOYMENT 


(  CRESS  ANY  L  E I  Tr.R  I  0  CO  NT  IN  PE  <  EX  Cl:  PT  J  E  )  ) 

(press  " i: "  to  t. an 


.i  4 

ii 


% 

H 


X 


THIS  EXAMPLE  IS  -INTENDED  TO  ILLUSTRATE  1:  HE  0  A  PA  B I L I  TIES  OF 
MAT.^Mr  AND  IN  NO  WAY  REFLECTS;  REAL  DATA  (.CLASSIFIED.  OR 
UNCLASSIFIED).  ALL  PREFERENCES  AND  VALUES  ARE  H YpdtHE T I C  At  ♦ 
WAYNE  A'*.  STIMPSON  19  NOV  -3198,1 
1  1 

TO  MAXIMIZE  aErodvnahj:c,  PERFORMANCE 


(PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  " E 11 ) ) 
(PRESS  "E"  TO  EXIT) 


.THIS  EXAMPLE  IS  INTENDED  TO,  ILLUSTRATE  THE  CAPABILITIES  OF 
.MADAM » -  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED-  OR 
UNCLASSIFIED),  ALL  PREFERENCES  AND  VALLES.  ARE  HYPOTHETICAL* 
WAYNE  A,  ST IMPS ON  19  NOV  1981 
1  1  1 

T  0  M  A  X I M 1 Z  E  I  1 1 C  H  ALT  I  T.U  D  E 
AERODYNAMIC  PERFORMANCE 


(PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  "!£“)) 
(PRESS  11  E“  TO  EXIT)  ‘ 

?d 


THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM?  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED) *  ALL  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL. 
WAYNE  .A.  8T.IMPS0N  19  NOV  1981. 

1  1  :  2 

ft  0  M  A  X I M I Z  E  L  0  W  -  A  L  T.  I T  W  D  E 
,  * 

1  ' 

AERODYInAHI C  •  PERFORMANCE 


((PRESS  ANY  LETTER  TO  LON IINUE  (EXCEPT  "'£")) 

{-(•PRESS  "  E '  TO  EXW) 

>  *>  ' 

!  Td 


THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM  ?  AND  IN  NO  WAY  REFLECT  S  REAL  DATA  ( CLASSIFIED  OR 
UNCI.  ASS  If  I  LB)  »  ALL  PRLF  IT.KLMCEb  AND  VALUES  ARE  HYPOTHETICAL 
WAYNE  A*  STIMPSON  IV.  NOV  19*81 
1  ?  ’  r 
TO  MAXIMIZE  AIRCRAFT  SURVTVAB1LI  fY 


( PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  . " E "  )  ) 
( PRESS  “E“  TO  EXIT) 

?d 


THIS  EXAMPLE  3  S  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES'  OF 
MADAM i  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED)*  ALL  .PREFERENCES  AND  VALUES  ALE  HYPOTHETICAL 
WAYNE  A,  STIMPSON  19  NOV  :t?8l. 

J  • '  ‘ 

TO  OPTIMIZE  MULT  I  •••■ROLE  COMBAT 

CAPABILITY 


(PRESS  ANY  LETTER  10  CONTINUE  (EXCEPT  "E“)> 
(PRESS  "IP  TO  EXIT) 

?;J 


THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  I  LIE  C ARAB  3D...  IT  I t?>lQF 
MADAM  f  AND  IN  MO  WAY  kELLECfS  REAL  DM  !  A  (CLASSIFIED  (JR 
UNCLASSIFIED).  -ALL  I 'KLEEREMU.  S  AND  VALUES  ARE  HYPXlT  WET-1  CAL 
WAYNE  A.  STIMPSON  i  °  NC'V  IV81 


TO  MAXI  M3  AIR  10-A.tR  COMBAT 


EFFECT I VEMESF 


81 


•( PRESS  ANY  LETTER  TO  CONTINUE  ( EXCEPT  "E * )) 
(PRESS  " E “  TO  EXIT) 

?d 


THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MAHAN'/  AND  JN  NO  WAY  REFLECTS  REAL  BATA  (CLASSIFIED  OR 
UNCLASSIFIED).  ALL  PREFERE-TCES  AND  VALUES  ARE  HYPOTHETICAL 
WAYNE  Af  S')  I  HP  SON  IV  NOV  1981 

j.  3.2  , 

TO  MAXIMIZE  AIR-TO-GROUND  COMBAT 
EFFECTIVENESS  * 


CPRESS  ANY  LETTER. TO  CONTINUE  (EXCEPT  "E“ )) 

( Press  "e*  to  exit) 


THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE. CAPABILITIES  OF. 

Madam?  and  in  no  way  reflects  real  data  (classified  or 

UNCLASSIFIED )  *  AI.L.  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL 
WAYNE  A,  STIMC'SON  19  NOV  3  981 
1  3  3 

TO  MAXIMIZE  RECCE  CAPABILITY 


< PRESS  ANY  LETTER  TO  CONTINUE  (EXCr  " 
(PRESS  "E"  ro  EX  I )  ) 

?e 


'  E " ) ) 


l«J .  8  T I M  P  S  0  N  ?  Y  0  U I  (  0  P  T  i  0  N  S  A  R  E  J 

ATT  COP  DIS  DON  MOD  NEW  NUN  PRU  REV ,  B EL- 

SEN'1  SPA  STA  SYS’-  TTL  WVC 

tf.«NU*r£T  IF  YOU  NEED  AN  EXPLANATION*  W.STInPSON 


WHAT  IS  YOUR  OH 0 1 C £  >  W  <  B T I M P SOM ? h e Tp  • 

THE  FOLLOWING  .EG  A  BRIEF  EXPLANATION  OF  THE  OPTIONS.-.  ..  FOR 
MORE  DETAIL »  SEE  THE  USER'S  MANUAL  r  W ,  STIMP30N*  '  . 


.‘Y#  ATT  *-**  ATTRIBUTE  LABEL  ENTRY  .  . 

A  '  »  *  v  , 

■He#*  COR  YYY  COPIES  ONE  NODE  TO  ANOTHER 

YYY  Ills  YYY  DISPLAY  OF  ONE  NODE 

YYY  DON  YYY  DONE  WITH  WORK  y  SAME  ALL  FILES 

YYY  HEL  YYY  WILL  REPEAT  TPI1S  INFORMATION 

YYY  MOIL  YYY  MODIFIES  EX  IS!'  TNG  TREE  y  NODE  BY  MODE 

YYY  NEW  YYY  NEW  TREE  BUILD I NO  DRIVER 

YYY  NUM  YYY  SAME  AS  REV r  BUI'  WITH  WEIGHTS  AND  VALUES 


(PRESS  ANY  LETTER  TO  CONTINUE) 
I’d 

YYY  PRU  YYY  PRUNES  THE  TREE  NODES 
YYY  REV  YYY  REVIEW  PRINT  OF  TREE 
‘YYY 


SEE 


YY  SELECT  TREE  FILE  ( STORED  DATA) 


'JW  '■)/'*/ 

A*  St\  *i* 

YYY 

YYY 

YYY 

'iv  YY 


SEN  YYY  CONDUCT  SENSITIVITY  ANAL? SIS 
SPA  YYY  ADDS  DOWNLINKS  TO  EXISTING  NODES 
STA  YYY  PROVIDES  TREE  STATISTICS. 

SYS  YYY  INPUT  ALTERNATIVE  SYSTEMS 
TTL  YYY.  DATA  FILE  TITLE  ENTRY 

WVC  YYY  LOADS  WEIGH  IS  AND  u  A  LUES  ■/  DUES  CALCULATIONS 

(PRESS  ANY  LETTER  TO  CONTINUE.) 

?d 


W .  S.TIMPSON  ?  YOUR  OPTIONS  ARE  \ 

ATT  COP  DIG  DON  MOD  NEW  NUM  PRU  REV  SET. 

OSI-N  SPA  STA  SYS  TIL  WVC 

YYYNOTE  t  IF  YOU  NEED  AN  EXPLANATION*  W »  S !  f.MPGUii 
TYPE  "HELP"  YYY 
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■,«  w.  -  ■  j 

”  **,  ' :  ’  '  '  -  >  * 


'  (<«v  f  i, ;iS  ?■* ‘•'li'Vw*1  f’ V<5s 

■  *•  <v  -V  .“  /  •?  -r  1  -':■'''  , : 


WH.A.X  IS.  YOUR.  CHOICE  r T1  ♦  STIMPSONf!,wvc 


V*  • 


YOU  HAY  NOW  ENTER.  WEIGHTS r  VALUES  ?  OR  (RECALCULATE 
.'THE  TREE .  CHOOSE  YOUR  OPTION t 

V  i  ALLIES  C(  ALCULATE  EtXIT 


W (EIGHT 

?M 


WEIGHTS 


A  ( L.L 


S ( ELECT 


WE  ARE  WEIGHTING  THE  NODE  SET } 

Id  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


THE  A DOVE  OBJECTIVE  IS  FACTOR  1 

to  Maximize  aircraft  survivability 


THE  ABOVE  OBJECTIVE  IS  FACTOR  2 
TO  OPTIMIZE  -MULTI-ROLE  COMBAT 


CAPABILITY 

THE  ABOVE  OBJECTIVE  IS  FACTOR  3 


DO  YOU  WISH  TO  ENTER  THE  RELATIVE  WEIGHTS  DIRECTLY •/ 
(Y/N)  ?n 
USING  THE  SCAI.  EL 

1-9  AS  DEFINED  IN  THE  USER'S  MANUAL y 
HOW’  IMPORTANT  IS  FACTOR  .1  L 
TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


COMPARED  TO  FACTOR  2i 


TC  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


ENTER  THE  .'NUMERATOR  OF  THE  RATIO*.. 

?1 

ENTER  fl-IE  DENOMINATOR  OF  THE  RATIO... 
v/? 
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•UjgySBfc* 


‘.USING  THE  SCALE* 

i-y  as.  defined  m  the  user's  manual. , 
HOW  important  is  factor  it 
TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


COMPARED  TO  ‘"  ACTOR  3t 
TO  OPTIMIZE  MULTI-ROLE  COMBAT 

'GAP ABILITY 

ENTER  THE  NUMERATOR  OF  THE  RATIO... 

n 

ENTER  THE  DENOMINATOR  OF  THE  RATIO. . . 
?4 

using  The  scale: 

AS  DEFINED  IN  THE  USER'S  MANUAL? 
HOW  IMPORTANT  IS  FACTOR  2t 
TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


COMPARED  10  FACTOR  31 
TO  'OPTIMIZE  MULTI -ROLE  COMBAT 

CAPABILITY 

ENTER  THE  NUMERATOR  OF  THE  RATIO... 

?1 

-ENTER  THE  DENOMINATOR  OF  THE  RATIO... 

?2 

normalized: 14  29  57 

ARE  YOU  HAPPY  WITH  THESE  RELATIVE  WEIGHTS?  (Y/N) 

Ta 

ENTER  COMMENTS  ON  THESE  WEIGHTS 

f'tjie  weight?  on  nod  os  1.1?  1.2?  and  1.3  reflect  the 
?  ex  pec  Led  scenarios;  do  r  in  si  alert  conditions 

WE  ARE  WEIGHTING  THE  NODE' SET: 

TQ> MAXIMIZE  HIGH- ALT I TUBE 

A  E  R  6  D  Y  N  A  M I C  P  E  R  F  0  R  M  A  N  C  E 

-  :  t  • 1 

« 

THE  ABOVE  OBJECTIVE  IS  FACTOR  1 
TO:  MAXIMIZE  LOW-ALTITUDE 

AERODYNAMIC  PER  F  0  R  M  A  N C E 

THE  ABOVE  OBJECT  I  VC’  fS  FACTOR  2 


DC)  YOU  WISH  TO  .ENTER  THE  RELATIVE  WEIGHTS  DIRECTLY  y-  " 
CY/N)  ?y  '  ,  ' 

•ENTER-  THE  (UNNORMALIZED)  WEIGHTS. 

WHAT  IS  THE  WEIGHT  FOR  FACTOR  X  . 

•?3  u  > 

WHAT  IS  THE  WEIGHT.  FOR  FACTOR  2 
?7 

.FORMALIZED} 30  70  -  .  '  ; 

ARE  YOU  HAPPY  WITH  THESE  RELATIVE  WEIGHTS'?  (Y./N-) 

?y 

ENTER  COMMENTS  ON  THESE  WEIGHTS  - 

?the  weights  on  riodeo  3.1*3,  and  1*1.2  reflect  increased 
Yconeern-  with  eas/bai  cons idera lions  • 
v  -  .  ' 

WE  ARE  WEIGHTING  THE  NODE  SET** 

TO  MAXIMIZE  AIR-TO-AIR  COMBAT 

EFFECTIVENESS^ 

THE  ABOVE  OBJECTIVE  IS'  FACTOR  1 
TO  MAXIMIZE  AI R -•  T 0 - GPi 0 U N D  COMBAT  • 

EFFECTIVENESS 

THE  ABOVE  OBJECTIVE  IS  FACTOR  2  : 

TCT  MAXIMIZE  RECCE  CAPABILITY 


THE  ABOVE  OBJECTIVE  IS  FACTOR  3 

DO  YOU  WISH  TO  ENTER  THE  RELATIVE  WEIGHTS  DIRECTLY y 

<Y/N>  Tn 

USING  THE  SCALE** 

1“9  AS  DEFINED  IN  THE  USER'S'  MANUAL y 
HOW  IMPORTANT  IS  FACTOR' li 

TO  MAXIMIZE  AlR-fh-AIR  COMBAT  v 

effectiveness 


COMPARED  TO'  FACTOR  2  i 

TO  MAXIMIZE  AIR-TO-GROUND  COMBAT 

»  *  % 

;V  :  '  .  ;ti 

EFFECTIVENESS  ' 


ENTER.  THE  NUMERATOR  OF  THE  RATIO,.. 

J  !  ni  '  . 

ENTER  THE  DENOMINATOR  OF  THE  RATIO*.. 


if)  '  USING  THE  SCALE: 

V  1-9  AS'  REFINED  IN  THE  USER'S  MANUAL ? 
N.QW  iHF'dfvTANTr  IS  FACTOR  IT 
y-f-' .  '  TO  .MAXIMIZE  A  IE  R-XO-A I  R'  GOHBA  t 

EFFECTIVENESS 


CON  PARED  TO  .FACTOR  3  ! 

TO  MAXIMIZE  RECCE  CAPABILITY 


ENTER  tHE  'NUMERATOR  OF  THE  RATIO.*. 

?3 

ENTER  THE  DENOMINATOR  OF  THE  RATIO... 
?1  ~ 

USING  THE  SCALE.: 

i-9  AS  DEFINED  IN.  THE  USER'S  MANUAL v 
HOW'  IMPORTANT  IS  FACTOR  2t 
TO  MAXIMIZE  AIR-TO-GROUND  COMBAT 

.'EFFECTIVENESS 


COMPARED  TO  FACTOR  3: 

TO  MAXIMIZE  RECCE  CAPABILITY 


.ENTER  THE  NUMERATOR  OF  THE  RATIO... 

?3 

ENTER  THE  DENOMINATOR  OF  THE  RATIO... 

f  1 

NORMALIZED  M3  43  14 

ARE  YOU  HAPPY  WITH  THESE  RELATIVE  WEIGHTS?  <Y/N) 

?y 

{ENTER  COMMENTS  ON  THESE  WEIGHTS 

:  ?the  we  i  ah  is  on  nodes  1 .3.1;  1 .3*2;  and  1.3.  "3  ref  1  eet 
?the  expectations  of  s  short;  f ost-mavinH  enassSeitierit 
v- 


YOU  MAY  NOW  ENTER  WEIGHTS,  VALUES,  OR  < RE) CALCULATE 
THE  TREE.  CHOOSE  YOUR  OPTION*. 

w  <  Fight  v<  allies  c  calculate  etxit 

?v 
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VALUES  !  A(Ll.  S(  ELECT 
?a 

WE  ARE  AT  THE  DATA  NODE4. 

TO  MAXIMIZE  H I G H ~ A L TITIJIJ E 

AERODYNAM1 C  PERFORMANCE 

WHICH  HAS  THE  ASSOCl'A  I'KD  ATTk  l.HU  I L  HIGH-AERO 

THE  CURRENT  LEVEL  Of  THE  ATTRIBUTE  HIGH-AERO 

IS  ->16666 6 6 6 6 6 6 6 7  FOR  SYS T If. M 

F-4 


THE-  RANGE  OF  THE  ATTRIBUTE  10  0*  ID  10. 
WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER)? 4.0 


THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  HIGH --AERO 

IS  *1666666666667  FOR  SYSTEM 

F-15 

THE  RANGE  OF  THE  ATTRIBUTE  IS  0.  TO  10. 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER) *8.0 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  1 1  fliH-AERO 
IS  .1666666666667  FOE  SYSTEM 

F-lll 


THE  RANGE  OF  THE  ATTRIBUTE  IS  0.  TO  1.0, 

WHAT  IS  THE  NED  LEVEL  (REAL  NUMBER)? 3.0 

ENTER  COMMENTS  ON  7 !  I  FOE  ENTRIES . 

?hisJh-aevo  rstinds  reflecl  dais  ('ruin  field 

I’estcerci  set.  concluded  over  the*  three  years 

v 

WE  ARE  AT  THE  DATA  NODt.fi 
TO  MAXIMIZE  LOW- Ai..T  LTUBC 

A E R 0 D Y N A M IC  Pi  1 K F 0 1 ■; M A N l ; L 

WHICH  HAS  THE  ASSOCIATED  ATTRIBUTE  LOW -AI-fRO 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  LOW-AERO 

IS  1.0280445 3 3 4 1 4  FOR  SYSTEM 

F-4 


THE  iRANGE  OF  THE  AT  ( R  (BUTE  IS  0.  TO  .1.0 


--i  ***  ^'"V"  ‘ 


WHAT  IS  THE  NEW  L  EVE) .  (  REAL  NUMBER > Yt . 0 
THE  INPUT  ATTRIBUTE  LEVEL  CAUSES 
THE  VALUE  GENERATED  (BASED  ON  THE 
ESTIMATED  INDIVIDUAL.  VALUE  FUNCTION) 

TO  BE  OUTSIDE  THE  KANGE  (0, 0-1.0). 

IN  ORDER  TO  REMAIN  IN  THE  PROPER  RANGE » 
YOUR  INPUT  VALUE  IS  BEING  CHANGED  TO 
1*02804453341  A 

IT  THIS  IS  UNACCEPTABLE*  USE  ***ATT**» 
TO  ADJUST  T H E  V A !.  U E  F UN 0 T 1 0 H .  A F 1 E I ? 
EXITTIN6  THIS  OPTION* 


THE  CURRENT  LEVEL.  01-  ‘1111'..  ATTRIBUTE  LOW -AERO  ' 

IS  1.020044533414  FOR  SYSTEM 

F-1S 

THE  RANGE  OF  THE  ATTRIBUTE  IS  ()<  (0  10. 

WHAT  IS  THE  NEW  LEVEL  (REAL  N UNDER ) Y  * 5 
THE  INPUT  ATTRIBUTE  LEVEL  CAUSES 
THE  VALUE  GENERATED  (BASED  ON  l HE 
ESTIMATED  INDIVIDUAL  VALUE  FUNCTION) 

TO  BE  OUTSIDE  THE  RANGE  <0.0-1 .0)* 

IN  ORDER  TO  REMAIN  IN  THE  PROPER  RAM OF  - 
YOUR  INPUT  VALUE  IS  BEING  CHANGED  TO 
1  •  02804  <153343  4 

IF  THIS  IS  UNACCEPTABLE?  USE  #t4’AVTW 
TO  ADJUST  THE  VALUE  FUNCTION;  AFTER 
EX ITT I NG  THIS  OP  1 1 ON. 

THE  CURRENT  LEVEL.  OF  THE  ATTRIBUTE  LOW- AERO 

18  1.028044533414  FOR  SYSTEM 

F-Ul 

THE  RANGE  OF  THE  ATTRIBUTE  IS  0*  TO  10. 

WHAT  IS  THE  MEW  LEVEL  (REAL  NUMBER  >?3  *  0 

ENTER  COMMENTS  ON  THESE  ENT  R  I.L.S  - 
?  t  h  e  1  o  w  e  r  o  v  l,  .i  n  :1  r  e  f  .1  a  c  l  e  n  .i  1 1  o  p  r  i  n  ri  d  s  t <? 
Ycombined  with  real  combat  data 
v 

WE‘  ARE  AT  THE  DATA  NODE  t 
TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


WHICH  HAS  THE  ASSOCIATED  ATTRIBUTE  VIJLNER 

THE  CURRENT  LEVEL.  OF  THE  ATTRIBUTE  VIJLNER 

T S  *  97 4  0 V 7 2 0 4 3  7 1 A  F  ( >  R  S Y S T E M 

F-4 


T^T  j 

M  ] 


THE  RANG!:  or  rilE  ATTRIBUTE  IS  1.  TO  0. 

WHAT  IS  THE  NEW  LLVEL  (REAL  NUMBER)? *2 

THE  CURRENT  LEVEL  Olr  THE  ATTRIBUTE  VUI.NEE 

IS  .9740972043714  FOR  SYS  HIM 

F-15 

THE  RANGE  OF  THE  A  IT  RI  BUTE  IS  I. »  TO  0. 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER)? *1 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  VUI..NER 

IS  ♦ 9740972043714  FOR  SYSTEM 

F--J.J.1 

THE  RANGE  OF  THE  ATTRIBUTE  IS  1.  TO  0. 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER >Y.2S 
iENTER  COMMENTS  ON  THESE  ENTRIES  < 

,?the  vulnerability  osti mates  are  baaed  on  the  assumption  of  a 

\  Tina  del  sortie  under  expected  value  conditions 
*? 

WE  ARE  AT  THE  BATA  NODE! 

TO  MAXIMIZE  AIR-TO-AIR  COMBAT 

EFFECTIVENESS 

WHICH  HAS  Til!"  ASSOCIATED  ATTRIBUTE  AIR-AIR 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  AIR-AIR 

IS  1.2195A622294*  FOR  SYSTEM 

F-4 

THE  'RANGE  OF  THE  ATTRJ  JUI CE  IS  !,  TD  5, 

WI-IAT  LS  1 1  IF  MEW  LEVEL.  (REAL  NUMBER )  *  0 


THE  CURRENT  l.FVFL  OF  TTH"  ATTRIBUTT:  AIR-AIR 

I S  I  .  2 3. 75662 2 2 V 4 6  FOR  SYS  T E M 

F-i5 

THE  RANGE  OF  THE!  ATTRIBUTE  IS  3.  TO  5. 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER)? 4. 5 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  AIR-AIR 

I S  1 . 2  1 9 5 6 6 2 2 2946  F 0 1  ?  S Y  S T E M 

F-311 


THE  RANGE  OF  THE  A  HR!  CUT:  3  S  l.  TO  b . 


if 


WHAT  IS  THE  NEW  LEVEL  <  REAL.  NUMBER  )  i'2 . 0 

ENTER  COMMENTS  ON  THESE  ENTRIES* 

Tair-sir  entries  involve  direct  Pilot  assessment 
v 

WE  ARE  AT  THE-  DATA  NODE-!  1 
TO  MAXIMIZE  AIR-TO-GROUND  COMBAT 

EFFECTIVENESS 

WHICH  HAS  THE  ASSOCIATED  ATTRIBUTE  AIR.- -GROUND 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  AIR-GROUND 

IS  . 9499290 2150972  EC)R  SYSTEM 

F-4 

THE  RANGE  OF  THE  ATTRIBUTE  IS  1.  TO  3* 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER )?2«0 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  AIR-GRCUJND 

IS  .9499290238972  FOR  SYSTEM 

F-15 

THE  RANGE  OF  THE  ATTRIBUTE  IS  1*  TO  3* 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER)?! *3 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  AIR --GROUND 
IS  ♦ 9 A 9 9 2 9 0 2 3 I? V 7 2  FOR  SYSTEM 
F-l  il 

THE  RANGE  OF  THE  ATTRIBUTE  IS  I*  U)  3* 

WHAT  IS  THE  NEW  LEVEL  ( REAL  NUMBER ) ? 1 » 73 

ENTER  COMMENTS  ON  THESE  ENTRIES. 

?  s  .i  i'  --  d  r  o  u  n  d  e  r  1 1  r  :i  c  s  a  r  e  fa  a  r»  e  d  o  n  c  o  m  h  a  l  d  a  t  a 
?and  ainn.il  at  j  on 
v 

WE  ARE  AT  THE  DATA  NODE J 
TO  MAXIMIZE  RECCE  CAPABILITY 


WHICH  HAS  THE  ASSOCIATED  ATTRIBUTE  RECCE 

THE  CURRENT  LEVEL  OF  THE  ATTRIBUTE  RECCE 

IS  1.032 2 0 1 6 0 0 7 3 5  FOR  SYSTEM 

F-4 

THE  RANGE  Hf-  THE  AT  I  IV 1 2:i.l  TE  LS  1,  H)  3. 
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WHAT  IB  THE  MEW  LEVEL  (  REAL  MUM  HER )  ?3  .  0 

TI-IF.  CURRENT  LEVEL  OF  THE  ATTRIBUTE 'RECCE 

IS  1 ♦052201680755  FOR  SYSTEM 

F-l.i 

THE  RANGE  OF  THE  ATTRIBUTE  IS  1»  TO  5. 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER  >'i'l .25 

THE-  CURRENT  LEVEL  OF  THE  ATTRIBUTE  RIXCE 

IS  1.052201680755  FOR  SYSTEM 

F-m 


THE  RANGE  OF  THE  ATTRIBUTE  IS  1*  TO  5, 

WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER >?3.5 
ENTER  COMMENTS  ON  THESE  ENTRIES . 

Tret'ce  entries  reflect  comm  and  and  staff  evaluations 

?6f  us  or  ordani  sat  ions 
v 


YOU  MAY  NOW  ENTER  WEIGHT S»  VALUES t  01': 
THE  TREE,  CHOOSE  YOUR  OPT TON l 

W( EIGHT  V  ( Al .Ui-.S  C<ALCU!AI  E 


( RE ) CALCULATE 


IKXIT 


INTERIOR  TREE 


VALUES  ARE  BEING  CALCULATES 


<•  ♦ 


W , ST IMPSON  j YOUR 
ATT  COP  BIS  DON 
SEN  SPA  STA  SYS 
'*«NQTEJ  IF  YOU 
TYPE  '.HELP"  **# 


OP  I' IONS  ARE  5 

MOO  NEW  NUM  PRO  REV  BEL 

TTL  WVC 

NEED  AN  EXPLANATION  e  W. ST IMPSON 


WHAT  IS  YOUR  CHOICE •>  W.  ST  IMPSON?  nun, 
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MOl-J  MUCH  DO  YOU  WANT  TO-  RE VIE U .  ♦  . 

A  ( I.  L.  S (ELECT 

?3 

IF  ANY  MODIFICATIONS  HAVE  BEEN  MADE  TO  THE  TREE 
SINCE  IT  HAS  BEEN  CAL  GUI..  A  TED  -NUMERICAL  VALUES 
WILL  BE  INCORRECT  * 

( PRESS  AMY  LETTER  TO  CONTINUE ) 

Yd 


REVIEW 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM v  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED).  ALL  PREFERENCES  AND  VALUES  ARK.  HYPOTHETICAL 
WAYNE  A  ♦  ST  I  MINION  19  NOV  I9BJ.  '  '  - 


NODE  REFERENCE  NUMBER (AMD  OBJECTIVE) ; 
1 

TO  OBTAIN  THE  BEST  AVAILABLE  PLANE 

FOR  FORWARD  DEPLOYMENT 

RELATIVE  WE.!.c!!!'J  1* 

CUMULATIVE  WEIGHT:  i. 


SYSTEM  VALUES: 

F- 4  F- IS 

49.09  00,20 


!•■•  .1  1  I. 


THE  WEIGHTS  ON  NODES  1.  >  1.  ?  1  ,2?  AND  1 . 3  REFLECT  THE 
EXPECTED  SCENARIOS  DURING  ALERT  CONDITIONS 
(PRESS  ANY  LETTER  TO  CON  f  IN  UK  ( EXCEPT  “  E  )  ) 

(PRESS  “E"  TO  EXIT) 

?<j 


REVIEU 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM t  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED ) .  ALL  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL 
WAYNE  A.  ST  I  HP  SON  .19  NOV  IvBi  ' 


NODE  RE  EE  REN  Of:  NUMBER  (AND  OBJECTIVE)  V 
.1  I 

TO  MAX  1. 01  V  I:  AH-  'i'iYU.sM  I  .  f-T  =.  i  -i 


RELATIVE  WEIGHT:  .  1  428571428571 
CUMULATIVE  U LICIT)  5  .1428571428571 


SYSTEM  VALUES': 

P-4  P-15 

13.45  24.31 


F-lll 


42.47 


THE  WEIGHTS  ON  NODES  l.lil  AMD  1.1.2  REFLECT  INCREASED 
•CONCERN  WITH  CAS/DAI  CO MSI DLL AT IONS 
(PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  “  E "  )  ) 

( PRESS  *E‘  TO  EXIT) 


REVIEW 

THIS  EXAMPLE  IS  INTENDED'  TO  ILL US  IRATE  THE  CAPABILITIES  OF 
MADAM t  AND  IN  HO  WAY  REFLECTS  REAL.  DA  I' A  (CLASSIFIED  Ok 
UNCLASSIFIED*.  ALL  PREFERENCES  AND  VALUES  ARE  I IYPOTHET  1.CA!.. 
WAYNE  A.  ST  IMP SON  .19  NOV  1901 

NODE  REFERENCE  NUMBER (AND  OBJECTIVE) 5 
.1  1  1 

TO  MAXIMIZE  IILOII-Al.  UTUDE. 

A E R 0 D Y N A M I C  PI L R I-  0 R h A N C E 

RELATIVE  WEIGHT:  .3 

CUMULATIVE  UE  TOUT  5  .  (H28U7  !  42837.1  4 


SYSTEM  VALUES: 

F-4  F-.1.3 

44.83  •  81.03 


F-lll 


29.31 


IIIGH-AERO  RATINGS  PL  I -LEG  I  DATA  FROM  KIEL  D- 
EXCERtlSES  CONDUCTED  OVER  THE  PAST'  JHRliC  ? EARS 
(PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  " E " > ) 
(PRESS  " E “  TO  EXIT) 

*?d 
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REVIEW 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPAMLI  .  IES  OF 
MADAM >  AND  IN  NO  WAY  REFLECTS  REAL  DATA  (CLASSIFIED  OR 
'UNCLASSIFIED ) .  ALL  PREFERENCES  AMD  VALUES  ARE  HYPOTHETICAL ♦ 
WAYNE  A ♦  ST IMP SON  19  MOV  1981 

NODE  REFERENCE  NUMBER (AND  OBJECTIVE) ♦ 

1  .1  2 

TO  MAXIMIZE  L.OW-AL VITUDH. 

AERODYNAMIC  PERFORMANCE 

RELATIVE  WEIGHTt  . 7 
CUMULATIVE  WE  I. 01 1  r :  ,1 

i 

SYSTEM  VALUES: 

F  -A  ?■  --  .1  3  I--J1.1 

0*00  O',  00  4S.11 

THE  LOW-nERO  RATINGS  REFLECT  ENO.TNEILR.IHG  DATA 

COMBINED  WJTH  RL'AL  COMBAT  nAYA 

(PRESS  ANY  LETTER  I'M  CONTINUE  (EXCEPT  T0)) 

(PRESS  "E"  TC  EXH) 

?d  '  ■ 


REVIEW 

THIS  EXAMPLE  IS  INTENDED  VO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM y  AMD  .I'M  NO  WAY  REFLECTS  REAL.  DATA  (CLASSIFIED  OR 
UNCLASSIFIED) *  ALL  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL. 
WAYNE  A.  ST. IMP SON  19  MOV  1901 

NODE  REFERENCE  NUMBER (AND  OBJECTIVE): 

1  2 

TO  MAXIM  1 7  E  A I R Cl ( A F  T  0 UR  V  3  V A B I L  .1  T  Y 


RELATIVE  WEIGHT :  .  28571. 42007. 1.43 
CUMULAT I VE  WE  I  GMT :  .  280  7 .1. 4  2007 1 43- 

SYSTEM  values: 

F--4  F-15  F-.I.J.1 

55.96  69.54  50,48 


THE  VULNERABILITY  EST3 MATES  ARE  BASED  ON  THE- ASSUMPTION’ OF  A 
MODEL.:  SORTIE  UNDER  EXPEC.'ED  VALUE  CONDITIONS 
(PRESS  AN:'  |  Ef  I'ER  KG  CUN'!  INUE  iCXCEPT  “  E "  )  ) 

< PRESS  "I..-  10  r.'Xil) 

?tj  .... 
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LJ  •  .  REVIEW 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM?  AND  IN  NO  WAY  REFLECTS  REAL.  DATA  (CLASSIFIED  OR 
UNCLASSIFIED).  ALL  PREFERENCES  .AND  VALUES  ARE  HYPOTHETICAL. 
WAYNE  A.  STIMPSON  19  MOV  19B1 

NODE  REFERENCE  NUMBER ( AND  OBJECTIVE ) * 

1  3 

TO  OPTIMIZE  MULTI -RULE  COMBAT 
"’CAPABILITY 

R  E  L  A  T I V  E  W  E  I!  <3  HT  5  . 5  7 1 4  2 8 57 1  4  2  8  6 
CUMULATIVE  WEI  (TIT  t  .  07 1420071 4204 

SYSTEM  VALUES! 

F~4  F~15  •  F-111. 

54.57  47.14  31,08 

THE  WEIGHTS  ON  NODES  1.3.1?  1.3.2?  AND  1.3.3  REFLECT'  ■ 

THE  EXPECTATIONS  OF  A  SHORT?  FAST  ••MOVING  ENGAGEMENT 
(PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  kE")> 

(PRESS  BE“  TO  EXIT) 

?d 


REVIEW  "  *  ' 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM?  AND  IN  NO  WAY  REFLECTS  RIAL  DATA  (CLASSIFIED  OR 
UNCLASSIFIED).  ALL  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL. 
WAYNE  A.  STIMPSON  19  NOV  1901 

NODE  REFERENCE  NUMBER (AND  OBJECTIVE); 

13  1  • 

TO  MAXIMIZE  AIR-TO-AIR  COMBAT 

EFFECTIVENESS 

RELATIVE  WEIGHT;  .4295714205714 
C  U  HULA  T I V  E  W  E  J  G I  I T  ;  .  2 4  4  8 9  7  9 5.9 1 8 3  7 


SYSTEM  VALUES; 

F--4  F  - 15 


10.44 


40.41 


70.10 


I"  ■11  1 


AIR -AIR  ENTRIES  INVOLVE  DIRECT  PILOT  ASSESSMENT 
( PRESS  AMY  l  .C  TIER  TO  CONTINUE  (EXCEPT  'E1)) 
(PRESS  •E*  10  EXIT) 

Vd 


REVIEW 

THIS  EXAMPLE  IS  ^INTENDED  TO  ILLUSTRATE  1  HE  CAPABILITIES  OF 
MADAM r  AMD  IN  NO- MAY  PER..!:. CTO  REAL  DATA  ( CLASSIFIED  OR 
UNCLASSIFIED).  ALL.  PREFERENCES  AND  VARIES  ARE  HYPOTHETICAL. 
WAYNE  A  v  S  !".t  HP  SON  lv  NOV  1981 

NODE-  REFERENCE  NUMBER (AMD  OBJECTIVE) ‘ 

13  2 

TO  MAXIMIZE  a  i:r-  to-  ground  combat 
EFFECTIVENESS 


R II L  A  T I V  L  W 1 1 T  0  !■  I T  ;  .42  3  K  7  J  4  2  0  S  V )  <: 
CUMULATIVE  WUIGHf J  *2418979591837 


SYSTEM  VALUES J 

F-4  .  F-IS  F-UJ. 

A? .96  29*43  39*36 

AIR-GROUND  ENTRIES  ARE  DASED  ON  COMBAT  DATA 
AND ' S^MULAT I  ON 

(PRESS  ANY  LLTIER  10  CONTINUE  (EXCEPT  "K.“  )) 
( PRESS  “ E ''  (0  EXIT) 

'  Td 


REVIEW 

THIS  EXAMPLE  IS  INTENDED  TO  ILLUSTRATE  THE  CAPABILITIES  OF 
MADAM,  AND  IN  NO  MAY  RF.FL.tC If  REAL  DAI  A  (CLASSIFIED  UR  , 
UNCLASSIFIED),.  ALL  PREFERENCES  AND  VALUES  ARE  HYPOTHETICAL 
WAYNE'  A.  ST  IMPS  ON  1?  NOV  19S1 


NOTE  REFERENCE  NUMBER (AND  OBJECTIVE): 
•i  3  3  , 

TO  MAXIMIZE  RECCE  CAPABILITY 


.FiEl.AT T  VE  WE  I  GHT  I  ,  3,428571428571 
ICUMULATIVE  WEI  C-Ml  1  ,00.I632AS3CA122 


BYSTEL'H  VALUES: 

F-A  ■  F-J5' 

5i4.9i  7  *  43 


<f.B,  ov 


RECCE  ENTRIES  REFLECT  COMMAND-  AND  R  FAFF  EVALD  ATI  OH 
OF  USER  Q R A V  !■  2.f\  1  1 1 1 A S 

(PRESS  ANY  LETTER  ID  CONTINUE  (EXCEPT  ■?.■}> 

( PRESS  TO  EXIT) 

?e 


W .  ST I MPSON y YOUR  OPT I ONS  ARE t 

ATT  COP  IMS  DON  HOD  MEW  HUH  PEL'  REV  SUL 

SEN  SPA  STA  SYS  TTL  WUC 

**#NOTEt  IF  YOU  NEED  AM  EXPLANATIONS-  UtSTIMPSON 


WHAT  IS  YOUR  CHOICE  >  W  » ST  f  MPBOWTdi 


E  N  T  E  R  N  0  H  E  T  0  B  E  D 1 B  P  L  A  Y  F  D »  »  « 

ENTER,  .  »  NRMT.'L 
0 

IF  ANY  MOD I FT CAT IONS  HAVE  DEEM  MADE  TO  THE  TREE 
SINCE  IT  HAS  BEEN  CALCULATED  » NUMERICAL  VALUES 
'WILL.  BE  INCORRECT, 

(PRESS  AMY  I.LTTFR  TO  CONTINUE) 

?d 

THE  PARENT  OBJECTIVE  IB: 

.TO  OBTAIN  THE  DEBT  AVAILABLE  PLANE 

FOR  FORWARD  DEPLOYMENT 


IT  HAS  3  SUBOBJECTIVES  (FACTORS), 
FACTOR  .1 J 

TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


^ - 5- -X  ^\Vv  ”  .-’  -•<>- 


FACTOR,  2J 

TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


FACTOR  3: 

TO  OP T I M 1 7  E  M U L 1 1  - R 0 i... F  C 0 H B AT 


CAPABILITY 


1  FACTOR  i 
F-4 

.  13*45 
1  FACTOR  2 
F-4 

55 » 96 
1  FACTOR  3 
F-4 

54 . 57 
SUMMARY  OF 
F--4 

49,0? 


cum  wr: 

F--15 

24*31 

DATA  MO  BE  CUM  WTJ 
F- 15 

69  *  54 
CUM  WTJ 

F-15 

47*14 

PARENT  NO BE  J 
F-15 

50 . 28 


.  1420571428571 
F-lll 

42.47 

.2857142857143 

F-lll 

50.48 

.5714285714286 

F-lll 

31.08 


F-lll 


38  ♦  25 


BRANCH 

0- 

— . 20 - 

- TO- . - 

. —60— . 

- 80— 

FACTOR 

1  i 

A  +  B 

+  c: 

+ 

FACTOR 

:»*.+ 

X 

i. 

1 

C  A  •}• 

B  + 

FACTOR 

3 

X 

c  4  b 

A  •}• 

+ 

BRANCH 

0- 

•—  . . .  [l  0 - 

. -4  0 - 

- 60 - 

- 80— 

LEGEND J 

SYMBOL; A  IS  SYSTEM !  F-4  SYMBOL JI-:  SYSTEM? F-15 

SYMBOL:  C  8  Y  S  T  E  H  J  F  -  .1.  1  1 


W ♦ STIMPSONf YOUR  OPTIONS  AREJ 

ATT  COP  BIS  DON  MOD  NEW  MUM  PPI.I  REV  SEL. 

SEN  SPA  STA  SYS  TTL  WVC 

***NOTEi  IF  YOU  NEED  AN  EXPLANATION;  W.STIMPSON 
TYPE  'HELP"  x** 

WHAT  IS  YOUR  CHOICE;  W . 5  J  IMPSONTdis  .. 


99 


I 

a 

‘I 


■7 

I 


1 


■A\ 

-i! 


,4 


ENTER  MODE  TO  BE  DISPLAYED... 


ENTER  * . ♦ NRNY 1 

i 

6 

TP  ANY  MODIFICATIONS  NAME  BEEN  MADE  TO  THE  TREE 
SINCE  IT  HAS  BEEN  CALCULATED  r NUMERICAL  VALUES 
WILL  BE  INCORRECT. 

(PRESS  ANY  LETTER  TO  CONTINUE) 

?ci 

THE  PARENT  OBJECTIVE  IS} 

TO  MAXIMIZE  AERODYnA”  £C  PERI  ORMAMCE 


IT  HAS  2  SUBOBJECT  ( VEH  (FACTORS). 
FACT  PR  1, 

TO  MAXIMIZE  HIGH  IT!  JOE 

AE ROD)  .  i.  C  PERFQRI  ,AMCE 


FA! 

TO  N  y  '  /.E  LOW-  >.TlT*.  i,. 
A!"f,  s JYNAiM  I  i TPFTPM.  .Nf  . 


.1.  FACTOR  1  DATA  NODE  CUM  WT !  , 042S07J.  42837 14 


F-4 

F-lf. 

F-lli 

-44,  J  2 

cj  1 . 0  3 

29 . 31. 

l'  FACTOR  2 

DATA  NODE  CUM  WT J 

.  I 

F--4 

\  --If, 

F  -:U  l 

0.00 

0.00 

48.  1.1 

SUMMARY  OF 

PARENT  NODE: 

F-4 

F-1S 

F  -•  111 

13.45 

24.31 

42.47 

100 

+ 


LEGEND  J 

SYMBOL! A  IS  SYSTEM.  F-4  SYMBOL } B  SYSTEM .F- 15 

SYMBOLIC  SYSTEM JF-111 


BRANCH  0 - 

.  . . -20 - 

- 40 - 

-60 - 

~  ~  u  0 - 

FACTOR  1*T 

+ 

C  +  A 

+ 

+D 

FACTOR  2#B 

+ 

i  C 

+ 

T 

BRANCH  0— - 

- 20 - 

- 40 - 

-60 - - 

~  80- - 

100 
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IP  ACTOR  2* 

TO  MAXIMIZE  AIR-TO-GROUND  COMBAT 
'EFFECTIVENESS 


FACTOR  3: 

TO  MAXIMIZE.  RECCE  CAPABILITY 


3 

FACTOR  1 

DATA  MODE  CUM  WTJ 

.2448979591837 

F- 

-4 

F-15 

F-l  3  1 

60 » 43. 

78.10 

10.46 

3 

FACTOR  2 

DATA  MODE  CUM  WTJ 

.2448979591837 

F* 

•4 

F-15 

F-l  11 

47.96 

29.43 

39 . 36 

3 

FACTOR  3 

DATA  NODE  CUM  WT{ 

.08163265306122 

F- 

-4 

F-15 

F-l  11 

56.91 

7.43 

68.09 

SUMMARY  OF 

PARENT  NODE!  ♦ 

F- 

-4 

F-15  ’ 

F-lll 

54.57 

•  47.14 

31.08 

BRANCH  0- 

- - 20 - 40 - 

”60 - 

—80 

FACTOR  1*+ 

c  +  + 

•LA 

B+ 

factor  2#+ 

+  B  C  A 

•L 

+ 

FACTOR  3*+ 

B  +  I 

AL  C 

+ 

BRANCH  0- 

! 

i 

1 

i 

1 

l 

t 

*0 

0 

1 

j 

t 

t 

1 

1 

! 

i  • 
i> 
O 
• 

! 

1 

1 

i 

( 

1 

“60 - - 

—80 

LEGEND  J 
SYMBOL: A  IS 

SYSTEM:  F-4  SYMBOL? 

B  SYSTEM  ? I 

—  IS 

SYMBOL  5  C  SYSTEM  ;  f" .1  3. 1 


U.STIM P S 0 H  v  Y (J U R  0 P T 1 0 M S  A R E  i 

ATT  COP  IiIS  DON  MOB  MEL'  MUM  PRO  RE 0  SEL 

SEN  SPA  STA  SYS  TIL  WOC 

toNOTEt  IF  YOU  NEED  AM  EXPLANATION >  W.SriHPSON 
TYPE  ’HELP"  #*# 


WHAT  IS  YOUR  CHOICE t  W.STIMPSONTsem 


SENS 'IT  1 VI  T  Y.  ANALY8  I S 


CHOOSE  YGUR  OPTION: 

OUMWT  R)ELMT  DEUEL  S) YSTEM 

?c 


E )  X  IT 


SENSITIVITY  ANALYSIS  FOLLOWS . . * 
ENTER  NRN  FOR  WHICH  CUMWT  IS 
TO  BE  PERTURBED..* 

ENTER. . . NRN?1 
1 
0 

TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


*5 


CURRENT  CUMWT  IS  .1420571428571 
MINUHUM  CUMWT  <0.-1. )  IS?. I 
MAXIMUM  CUMWT  (.1-1.)  IS?. 3 


CUMWT  ANALYSIS:  DAPULAR  '  G ) RAPHICAL  E)XIT 

?i 
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F-m 
3  £5  *  0378 
38 { 0870 
38  , 1 363 
38,1855 
38,2347 
38  *  2839 
38.3331 
38 . 3824 

38*4316 
38*4808 
38 . 0300 
38 . 0793 
38,6285 
38 . 677 7 
38.7269 
38 . 7762 
38,8254 
30,8746 
38,9238 
38 . 9731 
39.0223 


CUMWT  ANALYSIS:  DABULAR  GRAPHICAL  E)XIT 

Yd 


GRAPHICAL  ANALYSIS:  HCORMAL  E ( XE'ANDEB 

Yn 

LEGEND J 

SYHBOL-A  IS  SYSTEM iF-4  SYMBOL.--B  IS  SYSTEM U?-i5 

SYMBOLIC  I S  SYSTEM  :  F-- 1 1  I. 

SENSITIVITY  ANALYSIS  ON  CUMWT 


OVERALL  VALUE 

0 

20 

40 

AO 

BO 

100 

.11+++++++ 

++++++ 

++ ++++c+j 

+++AB+ 

•1  +++ 

++++++++I++++++++++ 

+ 

+ 

cm- 

B 

+ 

-1- 

+ 

+ 

c+ 

B 

+ 

+ 

X 

t 

+ 

+ 

Cl- 

B 

+ 

-1- 

+ 

.15++ 

+ +++•! 

+++++•» 

++++++C++ 

++AB++ 

++++ 

++++.{ ++++++. 

•+++++++ 

+ 

1- 

C+ 

AH 

+ 

+ 

+ 

X 

+ 

CM- 

AD 

.A. 

+ 

+ 

X 

1 

f 

CM- 

AB 

+ 

+ 

+ 

+ 

T 

CM- 

B 

+ 

+ 

+ 

♦  20-t  i 

++++  + 

+•»++++ 

+++++-KM-} 

4AB+++ 

+++++++++++++++■ 

-++•{  ++++ 

+ 

+ 

CM- 

AB 

+ 

+  . 

+ 

+ 

+ 

C+ 

AB 

•f 

-1- 

+ 

+ 

CM- 

AB 

+ 

+ 

+ 

+ 

CM- 

AB 

+ 

-1- 

.  25+4 

H  +++ 

.}. a.  .j. 

4 +++++(  rl 

A+B+.++ 

{•+++ 

+++++++++++++++++++ 

+ 

+ 

;M- 

AB 

+ 

+ 

+ 

J 

1 

CM- 

AB 

A. 

i 

+ 

+ 

+ 

+ 

CM- 

AB 

J\‘ 

•1 

+ 

4. 

t 

+ 

CM- A 

B 

.i, 

I 

+  . 

-1- 

.30++ 

+++++ 

++++++ 

+++++++CA+B++++ 

•>•+++ 

f ++++++ ++++++ ++++++ 

0 

20 

40 

60 

BO 

100 

OVERALL  VALUE 

(PRESS  AMY  LETTER  10  CONTINUE) 
Yd 


CUMWT  ANALYSIS:  T )  ABUL.AR  GRAPHICAL  E)XIT 

?sen 

ENTER  "TS'GS  OR  “ E " 


CUMWT  analysis: 

?f} 


T )  AUULAR  C )  RAP! !  I  CAL  E )  X I T 


U . ST IMPS ON r YOUR  OPTIONS 
ATT  COP  DIS  DON  MOD  NEW 
SEN  SPA  ST A  SYS  TTL  WVC 
MINUTE!  TP'  YOU  NEED  AN 
TYPE  •HELP*  *** 


ARE : 

nuh  peu  rev  sc:i... 

EX  PLANA!  ION  v  U .  ST  1  HP' BOM 


WHAT  IS  YOUR  CHOICE  *  W.STIMKSONTson  • 


SENSITIVITY  ANALYSIS 


CHOOSE  YOUR  OPTION! 
OUMWT  FOELWr 


DEVLI.. 


SJYSTKM 


SENSITIVITY  ANALYSIS  FOLLOWS... 
ENTER  NRN  FOR  WHICH  RELWT  F.S 
TO  BE  PERTURBED. .  ♦ 


ENTER. . . NRN?1 
2 

0  '  . 


TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


CURRENT  REl.WT.  IS  .2857142857143 
MINIMUM  RFLWT  (0,-1.)  TS1M 
MAXIMUM  REL.WT  (.1-3.)  IS? *5 


RELW'I  ANALYSIS  * 
?t 


T )  ABULAR  GRAPHICAL 


:0R  NODE  J 


E)xn 


TO  MAXIMIZE 

AIRCRAFT  SUEVIUABIL 

ITY 

0 

RELWT 

F-4 

F-15 

F-lll 

.  1000 

47.3076* 

45 , 2722 

35 . 0677 

.1200 

47.4998# 

45.8114 

35,4102 

■  ,1400 

47.6919# 

46 , 3506 

35 , 7 520 

"  .1600 

47.8841* 

46.8898 

*  36,0954 

.1800 

48.0763* 

•  47 , 4289 

36.4380 

.2000 

48,2685* 

47,9681 

36 , 7806 

4 

,  v 

.  2200 

48.4607 

48 , 5073* 

37.1231 

i  .' 

.2400 

48 , 6529 

49,0465# 

37,4657 

,  2600 

48.8451 

49.5857* 

37 . 8083 

■'  ';.' 

gp:  S  •-  1-.  • 

|gv.  '"Ujr 

.  2800 

49,0373 

50.1249* 

38,1509 

,  3000 

•  49.2295 

50.6641* 

38.4935 

,  3200 

49,4217 

51,2032* 

38,8360' 

* ; 

♦  3400 

49,6139 

51.7424* 

39.1786 

,3600 

49.8061 

52.2816# 

, 39.5212 

,3800 

49,9983 

52 , 8208* 

39 . 8638 

* 

.4000 

50,1904 

53,3600* 

40.2064 

,4200 

50.3826 

53.8992* 

40.5490 

-v-,  '  , ,  , 

.4400 

50.5748 

54.4384* 

40.8915 

•/,* 

♦  4600 

50.7670 

54,9776* 

41,2341 

V’i  , 

.4800 

50.9592 

55.5167* 

41.5767 

.  5000 

51,1514 

56.0559* 

41.9193 
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REL-ur  ANALYSIS 
?e 


-I )  ABU  LAN  GRAPHICAL  L )  X I T 


U .  ST  I  HP  SUN  f  YQ'JK  OPTIONS  ALL  J 
ATT  COP  HIS  BUN  .MOD  NLU  NUN  PRU  REV  SEI¬ 
SE- N  SPA  S  i  A  SYS  )  TL..  WVC 

***NOTE!  tF  YOU  NEED  AN  EXPLANATION »  W.STIMPSON 
TYPE  •HELP*  *** 

WHAT  IS  YOUR  CHOICE*  W*STIMPSON?l 
L  '  IS  HO T  A N  A I .  L 0 W E D  E N T R  Y  >  W  > 8 T I M P B  0 N . 


W  <  !:> T 1 M P S 0 N  v  YOU R  0 P T 1 0 N S 
ATT  OOP  DIB  HON  MOD  NEW 
SEN’  SPA  ST A  SYS  TTL  WVC 
WNOTE!  )F  YOU  MEED  AN 
TYPE  *  HELP  ’•  *#* 


ARE  t 

NUN  PRU  REV  SKI. 

EXPLANAT  J’  ON  *  W  ♦  ST  1 MPSUN 


WHAT  IS  YOUR  CHOICE*  W.STIMPSONYuon 


SENSITIVITY  ANALYSTS 
CHOOSE  YOUR  OPTION J 

CHIMWT  R  >  EL-WT  DEVEL  OYSTEM 

?1 


SENSITIVITY  ANALYSIS  FOLLOWS  * . * 
ENTER  NRN  FOR  WHICH  LEVEL  IS 
TO  BE  PERTURBED* ♦  , 

ENTER. * .NRN vi 

2 

0 


E  >  X I T- 


T  0  M  A  X I M 1 2  L  A  Li  :,€  R  AFT  B  1.1  R  VIVA  B I 1. 1 T  Y 


F-lll 


SYSTEMS  available: 

F:‘~4  F-1S 

ENTER  SYSTEM  OF  WHICH  VJLNER  IS  TO  BE 

PERTURBED . . . 

?  f-4 

CURRENT  NODE  LEVEL  IS  ,2 

WE  ARE  WORK  I  NO  W.I.II1  AT  TRIM*  I E  i  VULNER 

MINUMUM  LEVEL  <0  .  -  t  ,  )  IS?  ,  .1. 

MAXIM  U  M  L  E  V  E 1 ..  <  .  1  -  J.  ,  )  1 8  ? .  5 


LEVEL.  ANALYSIS:  T )  A B WEAR  0>RAI:'HICAI. 

Yt 


E)XIT 


level: level:  vulher 

for  node:  . 

TO  MAXIMIZE  AIRCRAFT  SURVIVABILITY 


LEVEL 

•F-4 

.1000 

52 . 9720* 

.1200 

52 . 0780* 

.  1400 

5 1.2559* 

♦  1600 

50 . 4907# 

.1800 

49.7720 

.2000 

49.0922 

.  2200 

48.4457 

.2400 

47.8279 

.2600 

47 ♦ 2354 

.  2800 

46.6652 

♦  3000 

46.  .1151 

.  3200 

45.5830 

.  3400 

45.0674 

♦  3600 

44 . 5666 

♦  3800 

44.0796 

..4000 

43 . 6053 

.4200 

43 . 1 427 

.4400 

42 , 6?v9 

.4600 

42 . 2494 

.4800 

41. 0  J  73 

.  5000 

41.3941 

F--.1.5 

F-lll 

50 . 2789 

38 . 2488 

50 ♦ 2789 

38 , 2488 

50 . 2789 

38 ♦ 2488 

50 . 2789 

38.2483 

50 . 2789# 

38*2438 

50.2789* 

30.2488 

50.2789* 

38.2480 

SO . 2789* 

33 . 2488 

50.2789* 

38 . 2488 

50 . 2789* 

38 . 2488 

50.2789* 

38 . 2488 

50.2789* 

30,2488 

50.2789* 

38 . 2488 

50 . 2789* 

•30,2488 

50 . 2789* 

38 . 2488 

50 . 2789* 

38.2488 

50 . 2789* 

38 , 2488 

50.8789* 

38 . 2488 

50 . 2/89* 

38 , 2483 

50 , 2789* 

33.2488 

50 , 2789* 

30*.  2488 
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LEVEL  ANALYSIS:  T TABULAR  GRAPHICAL  E)XIT 


GRAPHICAL  ANALYSIS!  N ( ORMAL  E ( X PAN DEB 

?n 

LEGEND  5 

SYMBOL" A  IS  SYSTEM :P™4  SYMBOLS  IS  SYSTEM J V -15 

SYMBOL ~C  IS  system:!-- in 

LEVEL  ANALYSIS  ON  SYSTEM  !' . 1 

FOR  ATTRIBUTE  V ULMER 

OVERALL* VALUE 


0 

20 

40 

AO 

80 

100 

12114 

1 1+1+1 

1+1+4  1 

1+4 

fC+14- }  +BA+ 

Ml  HI 

1+14  4  Mil  1+1 11+4- 1 

X 

i 

c+  :a 

X 

i 

*  1 

4- 

+ 

1 

Cl  B 

X 

1 

4-  *  ’ 

X 

» 

+ 

1 

Cl  B 

1 

1 

■  4- 

;k>mi 

++++-:-+ 

+11+4 4 

+1+ 

1C +14  UBi-t 

•H 114  1 

14*1 !- 

11  Mil 

1+14-1-M 

{• 

. 

{• 

Cl  AB 

.1. 

1* 

1 

•i 

1 

CM  AB 

1 

1 

1 

♦ 

» 

4- 

Cl  AB 

1 

I 

4- 

+ 

C4  A  B 

•}• 

, 

4- 

*]■ 

301+4 

+  ■>  H+  + 

!•+•!  1  { 4- 

•!  1  1 

10  H  {-AT  B  !  •! 

H  1  HI 

1 1 4-  4 

1+1+11 

111  Ml 4- 

4 

1 

(.:•}■  a  c 

1 

f 

4- 

1 

'!• 

C4  A  e 

.1. 

1 

1 

1 

Ct  A  B 

1 

JL 

i 

» 

1 

ci  a  n 

4- 

1 

1 

40.1+1 

4-4-  f  1 t-  }• 

++++++ 

4-  !■  4- 

1C11A+1B1+ 

+4-  { •111+.+++ 

1  Ml-f-Ml  114-11 

1 

+ 

01  A  ‘  I: 

JL 

: 

1 

-1- 

X  ■ 

1 

*  * 

X 

1 

' 

CIA  B 

1 

‘  4-  - 

4- 

4 

J. 

1 

CIA  B 

4- 

1 

X 

i 

X 

i 

•1- 

CIA  B 

1 

1 

X 

-  *■» 

50+14 

1+fl+l 

++I+++ 

+1+ 

1C1AM1B-:  1 

111 -Ml 

14-11 

•111  111 

4  mm 

o 

20 

TO 

60 

130 

100 

OVERALL  VALUE 


<  PRESS  ANY  LETTER  TO  CONI  I HUE) 


y  ,4AjRW! 

''■  ’  •  t  r 


LEVEL  AMALYB IS :  T ) APUL.AR  G >  RAPH I CAL  E )X I T 

v  ?e 


W  *  Bf  IMPSQN  y  YOUR  OPTIONS  ARE.  I 

ATT  COP  DIR  PON  MOD  NEW  MUM  PRl)  MEV  !>EI. 

REN  BP  A  ST  A  -BY'-:  HT.  WVC 

***N0TEl  EF  YOU  NEED  AN  EXPLANATION 9  M . BTIMPBON 

type:  *  help  - .  r« 

WHAT  .IS  YOIJR  CHOICE »  W .  B  H  HPSON  ?s«u 


0 


S  i:  i  f  B I T 1 V 1 1  Y  A  N  A  L  Y  B I S 
CHOOSE  YOUR  OPT TOM* 

OUMWT  R>El..Wf  I.  ) FUEL  B)YS'.EH 


E)XIT 


SYSTEMS  AUA.ELAP.LJ:.: 

F~4  F-'l.  l"i  Pin 

WHAT  BY  STEM  TO  TO  DLL  ANALYZED? 

?f--4 


WHAT  TYPE  OF  ANAL.  (RIO  WOULD  YOU  LIKE  TO  HO... 
OUMUT  R)E!.Ur  VJALIJE 
•  .  Yc 


HOW  MANY  NODES  WOULD  YOU  LIKE  TO  EXAMINE?  (1-50) 
V03 


•ENTER  NRN  FDR  WHICH  CUMUT  IS 
TO  BE  PERTURBED*.. 

ENTER ♦ ♦ ♦NRN?t 

•1 J 

0 

THE  OBJECTIVE  TO? 

TO  MAXIMIZE  AERODYNAMIC  PERFURMANC 


ENTER  NRN  FOR  Oil  r  CM  CUM  NT  IS 
TO  BE  PERTURBED . .  . 

ENTER. . . NRN?! 

n 

o 

fl-lF.  OBJECTIVE  IS V 
TO  MAXIMIZE  AIRCRAFT  SURV1 VABI  LIT Y 


ENTER  NRII  FOR  WHICH  CUrtW  f  US 
TO  BE  PERTURBr.Ii .  .  . 

ENTER. . » MRNI 1 
3 
0 

4 

THE. OBJECTIVE  IS? 

TO  OPTIMIZE  MUL  f I -ROLE  COMBAT 

CAPABILITY 


MINIMUM  CUMUT (0.-3  ,  )  I  3?  .  V. 


MAXIMUM  CIJMWK  ,2-1.  >.  IS?. 7 


BY STM  ANALYSIS: 
T  t 


T)  AIUJLAR  6>RflPHXCr>L 


E )  X  L  f 


FOR  SYSTEM  F---4 


CMMWT 

MO  HE 

*  2000 

46.7359 

so' 

45.6 763 

,2500 

4  4  ^  63  *j  / 

.2750 

43.5971 

.3000 

42 , 3575 

.  3250 

41,5179 

.  3500 

40.4783 

.  3750 

39.4586 

.  4000 

38 . 3990 

.  4250 

37.3594 

,  4500 

36.3198 

,  4750 

35 , 2802 

.5000 

34,2406 

.  5250 

33,2010 

:  ,  .5500 

32,1613 

.5750 

31 . 1217 

.  6000 

30,0821 

.  6250 

29 . 0425 

,  6300 

28 . 0029 

.  6750 

26 , 9633 

.  7000 

25,9237 

Moot: 

KOBE 

40 . 2685* 

44.3438 

40 . 5088* 

44 ,  <47)34 

48 , 7 490* 

44 . 9830 

48 , 9092* 

45 . 3026 

49 , 2295* 

45 . 6222 

49. 4697* 

45.9418 

49. 7  1.00* 

46.2614 

49 . 9302* 

46.5810 

30.1904* 

46.9006 

50.4307* 

47 . 2202 

50 . 6709* 

47.5398 

80.9112* 

47 . 8594 

5.1  -.  1514* 

.  48.1790 

5  1  .3916* 

48 . 4986 

51  ,6319* 

48.8183 

5  1. .  8721.* 

49 . 1379 

3?, 1124* 

49 : 4573 

82 . 3526* 

i 49,7771 

52 . 3929* 

50 , 0967 

l.!"/  0771  -y 

J/,  ir  W  vH,*  J  *•* 

30.4163 

b  *5  *  C  /  £  v5 

50.7359 

BY STM  ANALYSIS t 


T )  ABIJLAR  OiKAf’Hir.AL  E>Xir 


GRAPHICAL  ANALYSIS!  N < ORMAL  E(XPAND£D 
Yr. 

LEGEND { 

8YMBQL-A  IS  NODE: 

TO  MAXIMIZE  AERODYNAMIC  PERFORMANCE 


SYMBOLIC  IS  NODE} 

TO  MAXIMIZE  A  .IRC  R  ALT  Ollpu  fVABl  LI  I  Y 


SYMBOLIC  IS  NO BE t 
TO  OPTIMIZE  Mill. I I-RL  K  COMDAI 


CAP  A  Dll  ..I  I'Y 


SENSITIVITY  ANALYSTS  ON  SYOTM 
FOR  SYSTEM  F -A 


OVERALL  VALUE 

0  20  AO  60  BO  100 

,  P.3+++  H  i  ++•!  •!•  H-+++++  m++CAB++++++-»  ++  K+++++++++++++++ 


+ 

j. 


■  33+++++++H- 


+ 

i 

+ 


•i* 

+ 

C  B 

•5 

V 

+ 

A  CD 

+ 

+ 

J. 

i 

+A 

C  B 

+ 

+ 

+++++T +++A+CH  B+ 

+++++ 

+++!++++•} 

+ 

A 

C  I: 

+ 

•1 

JL 

i 

A 

C  D 

•{. 

+ 

+ 

A  I- 

C  B 

X 

l 

I 

lit 


Lb 


+ 


A 


A 

A 


A 


H-t+A+++H  H 
A  + 

A  + 

A 

A  ■}• 


-I  \ 
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VI.  Conclusions  and  Recommendations 
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This  research  project  has  generated  several  observations  pertaining 
to  this  project  and  t:o  potential  work  on  similar  projects.  These  obser¬ 
vations  may  be  most  clearly  considered  by  examining  those  which  apply 
directly  to  this  research  first  and  then  considering  those  which  apply  to 
future  research.  In  order  to  most  concisely  present  those  observations 
which  apply  to  this  research,  it  is  useful  to  artifically  decompose  the 
decision-making  process  into  subprocesses.  These  subprocesses  are:  for¬ 
mation  of  the  alternative  system  set  to  be  considered,  construction  of 
the  objective  hierarchy,  generation  of  an  attribute  set,  super  position  of 
a  preference  structure  onto  the  alternative  system  set,  and  observation 
of  choice  sensitivity  to  perturbed  parameters.  It  should  be  noted  that 
the  above  decomposition  is  indeed  artificial  in  that  all  of  these  "sepa¬ 
rate"  activities  impact  one  another,  and  there  is  no  clear  cut  distinction 
where  the  boundary  of  one  activity  relative  to  another  may  be  set. 

With  respect  to  the  formation  of  the  set  of  alternative  systems, 

MADAM  does  not  offer  much  to  the  enhancement  of  an  unaided  DM.  Since  the 
program  is  designed  to  handle  a  relatively  general  class  of  problems,  it 
is  virtually  impossible  to  predispose  MADAM  toward  offering  or  selecting 
alternative  systems  as  a  solution  to  the  problem  at  Hand.  There  may  be 
some  consideration  given  to  designirg  decision-aids  to  fit  more  specific 
types  of  problems  (a  decision  template)  so  that  certain  alternatives  may 
be  automatically  generated.  This  may  prevent  the  waste  of  effort  in  having 
to  redo  the  problem  analysis  for  the  omitted  systems,  not  to1  mention  the 
embarassment  of  a  DM  who  war,  too  pressured  for  time  to  carefully  consider 
alternative  options. 
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With  respect  to  the  construction  of  an  objective  hierarchy,  MADAM 
does  offer  several  advantages.  Although,  as  stated  above,  the  program 
considers  a  set  of  problems  too  general  to  offer  predisposed  suggestions, 
it  does  provide  a  thorough  consideration  of  the  hierarchy  formation  at 
each  step  (if  the  between-node  check  is  being  used).  At  the  very  least 
the  program  provides  a  convenient  mechanism  for  storing  and  modifying  the 
hierarchy.  At  best,  it  may  alert  the  DM  to  potential  hazards  during  con¬ 
struction  of  the  hierarchy  that  would  impede  further  analysis  and  result 
in  much  wasted  effort  and  frustration.  As  before,  if  one  were  willing  to 
trade  general  applicability  for  specificity,  it  would  be  possible  to  de¬ 
sign  an  aid  which  is  predisposed  toward  a  suggested  hierarchy  or  set  of 
hierarchies . 

With  respect  to  the  generation  of  an  attribute  set,  MADAM  offers 
several  advantages  over  thr  unaided  DM.  This  program  not  only  convenient¬ 
ly  stores  and  works  with  the  attribute  set,  but  it  also  aids  the  DM  in 
quickly  identifying  problems  with  the  attribute  set  which  will  cause  com¬ 
plications.  Not  only  does  MADAM  assist  in  the  generation  of  the  attri¬ 
bute  set,  but  once  the  attribute  set  is  established,  MADAM  provides  a 
convenient  mechanism  for  measuring  and  storing  the  individual  value  func¬ 
tions  defined  over  each  attribute.  This  step  exploits  the  virtually  in¬ 
stantaneous  computational  capability  of  the  computer  to  provide  early  in¬ 
sights  into  the  DM's  preference  structure. 

The  stage  of  superimposing  the  DM's  preference  structure  onto  the 
alternative  system  set  is  critical.  The  crux  of  a  MAUT  analysis  is  to 
provide  the  mechanism  for  such  a  task.  MADAM  allows  the  use  of  an  addi¬ 
tive  overall  value  function  for  finding  the  final  ranking  of  the  alterna¬ 
tives  with  respect  to  preference.  The  program  provides  the  mechanism  to 
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test  the  independence  condition  among  the  attributes  which  justified  use 
of  the  additive  form.  If  this  testing  is  undesired  or  unnecessary,  the 
program  allows  this  testing  to  Be  skipped.  It  may  be  noted  that  although 
MADAM  exploits  the  equivalence  of  PPI  and  MPI  to  reduce  the  testing  to  a 
polynomial  rather  than  exponential  function  of  the  number  of  attributes, 
it  is  possible  that  the  still  lengthy  process  of  PPI  testing  may  incline 
the  DM  to  ignore  or  avoid  this  process. 

It  is  with  respect  to  the  sensitivity  to  parameters  that  MADAM  of¬ 
fers  the  most  outstanding  advantages  over  the  unaided  DM.  By  utilizing 
rapid  computational  capability,  MADAM  offers  the  advantage  of  performing 
a  dynamic  as  well  as  a  static  decision  analysis.  The  program  allows  the 
testing  of  sensitivity  of  the  alternative  system  values  to  all  of  the 
critical  parameters  of  the  type  of  problem  appropriate  for  analysis  with 
MADAM:  relative  weights,  cumulative  weights,  and  attribute  levels.  The 
program  allows  comparison  of  systems  at  a  single  node,  or  comparison  of 
a  single  svstem  response  over  a  set  of  nodes. 

To  see  more  clearly  where  MADAM  rests  relative  to  the  concerns  of 
other  researchers,  it  is  useful  to  see  what,  if  any,  of  their  concerns 
are  incorporated  into  MADAM.  The  suggestions  of  Morlan  (1979)  offer  a 
useful  example.  He  suggests  that  a  decision  aid  should  allow  a  sensitiv¬ 
ity  analysts  over  the  attribute  levels.  Clearly  this  is  met  by  MADAM. 
Morlan  also  suggests  that  sensitivities  over  simultaneous  changes  in 
several  nodes  is  useful.  MADAM  does  allow  the  comparison  of  nodes  based 
on  individual  changes,  but  due  to  concerns  with  introducing  confusion  in¬ 
to  the  sensitivity  analysis,  and  the  problem  of  interpreting  rates  of 
change,  a  simultaneous  sensitivity  analysis  does  not  appear  to  offer  much 
to  the  DM  in  terms  of  information.  Other  suggestions  of  Morlan's  include 
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measuring  actual  value  functions  and  considering  independence  testing  be¬ 
tween  the  attributes.  MADAM  has  addressed  both  considerations.  Lee  (1981) 
also  suggests  the  use  of  actual  value  functions  so  that  the  DM  may  work 
with  real  attribute  levels. 

As  noted  in  the  background  of  this  project,  Kelley  (Fischer  et  al , 
1978)  noted  that  important  functions  of  decision  aids  are  to  facilitate 
communication  and  storage  of  rationales  behind  the  model  parameters,  and 
to  offer  special  help  in  problem  structuring.  MADAM  provides  a  useful 
vehicle  for  both  of  these  functions.  It  must  be  noted,  however,  that  al¬ 
though  MADAM  is  designed  to  be  as  machine  independent  as  possible,  use 
of  the  program  does  involve  access  to  a  reasonably  larger  computer  (work 
space  of  about  60,000  words).  Also,  use  of  the  program  requires  a 
FORTRAN  V  compiler.  The  present  segmentation  of  the  program  into  over¬ 
lays  suitable  for  the  CYBER  175  system  is  easily  convertable  into  a  seg¬ 
mentation  appropriate  to  a  new  host  system. 

Utilizing  the  above  observations  of  MADAM  in  its  present  form,  sev¬ 
eral  observations  may  be  made  concerning  future  research  projects  of  a 
similar  nature.  In  the  short-term,  there  are  two  developments  that  would 
be  fruitful.  First,  by  modifying  the  algorithm  which  generates  the  indi¬ 
vidual  value  functions,  and  that  which  elicits  the  attribute  levels  of  the 
alternatives,  MADAM  could  be  converted  into  a  program  which  allows  a 
utility  function  analysis  (that  is,  it  could  directly  incorporate  risk  in¬ 
to  the  analysis).  Independence  testing  among  the  attributes  would  have  to 
be  modified  so  as  to  use  the  independence  conditions  required  in  utility 
theory  rather  than  those  of  value  theory.  A  second  short-term  benefit  may 
be  gained  by  constructing  a  library  of  objective  tree  templates  which 
could  be  accessed  by  MADAM  to  aid  in  the  rapid  analysis  of  certain  types 
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of  problems.  The  template  objective  hierarchies  could  be  tailored  through 
the  ***SPA**\  ***M0D***,  and  ***PRU***  options  to  fit  the  actual  problem. 
The  library  could  also  contain  appropriate  alternative  sets  so  as  to  gen¬ 
erate  some  of  the  advantages  mentioned  earlier. 

Reaching  further  into  the  future  for  mid-term  benefits,  it  would  be 
advantageous  to  expand  the  independence  testing  and  computational  abili¬ 
ties  to  include  other  decompositions  besides  the  additive  case.  This 
could  be  combined  with  the  earlier  work  of  providing  a  utility  analysis. 
Finally,  in  the  long  term,  it  would  be  beneficial  to  pursue  the  imple¬ 
mentation  of  the  current  work  by  Farquhar  (1979)  which  would  Involve  using 
a  set  of  the  attributes  to  "span"  the  consequence  space,  thus  allowing 
for  use  only  of  individual  utility  functions  rather  than  complicated  de¬ 
composition  approaches. 
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Appendix,,  A 


Glossary 


Note  -  the  following  tree  hierarchies  will  be  used  to 
demonstrate  several  defined  concepts: 


A 


AA  AB 

H — i 

AAA  AAR  AAC 

AAAA  AACA 

(tree  structure)  (data  structure) 

backlink  -  this  is  a  construct  o*  the  data  structure.  It  represents 
the  node  preceding  a  back! inked  node  (AA  is  the  backlink 
of  AB,  A  is  the  backlink  of  AA). 


A 

I 

AA - --AB 

AAA - AAB - AAC 

i  I 

AAAA  AACA 


branching  node  -  a  node  with  at  least  one  descendent. 


children  -  a  hierarchical  construct.  The  children  of  a  node  are  those 
nodes  down  one  level  from  a  node,  and  descendants  of  that 
node.  (A  has  children  AA,  AB;  AA  has  children '.AAA,  AAR, 
AAC). 


completeness  -  a  set  of  attributes  is  complete  if  it  is  adequate  in 
indicating  the  degree  to  which  the  overall  objective  is 
met. 


Glossary  (oontd) 

*  .  * 

comprehensive  -  a  quality  of.^an  attribute  if,  by  knowing  the  jevel  of 
an  attribute,  the’ DM  has  a  clear  understanding  of  the  extent 
to  which  the  .associated  objective  is  achieved. 


crosslink  -  a  data  structure  concept.  The  first  sibling  node  is  the 
crosslink  to  a  node.  (AB  is  a  crosslink  to  AA,  AAC  is  a 
cross  link  to  AAB) . 


cumulative  weight  -  the  weight  of  a  node  relative  to  the  root  node^ 

This  represents  its  contribution  to  the  overall  hierarchical 
structure. 


data  node  -  a  node  with  no  descendants.  Its  objective  has  an  associated 
attribute. 


decomposable  -  the  attribute  set  is  decomposable  if  the  tasks  of 

quantifying  the  DM‘s  preferences  for  consequences  can  be 
broken  down  into  parts  of  smaller  dimensionality. 


descendant  -  a  node  which  occurs  lower  than  a  given  node  on  the  hier¬ 
archy. 

depth-first  search  -  a  synthesis  of  data  and  logic  structure  concepts. 
This  technique  adds  new  levels  first  (if  possible)  then 
goes  to  the  crosslink  nodes.  A  depth-first  traversal  of 
the  example  is  the  ordering: 

A,  'AA,  AAA,  AAAA,  AAB,  AAC,  AACA,  AB 


direct  preference  measure  -  the  DM  must  directly  assign  the  conditional 
expected  utilities  for  achieving  the  objective. 


goal  -  a  specific  level  of  an  attribute  which  is  achieved  or  not. 


level  -  represents  the  number  of  nodes  separating  a  giver  node  from  the 
root  node.  , (A  is  level  1,  AAAA  is  level  4), 


measurable  -  an  attribute  is  measurable  if 

(1)  it  is  possible  to  obtain  a  probability  distribution 

•  ( ' ")  over  the  possible  levels  of  the  attribute  end 

(2)  it  is  possible  to  assess  the  DM ’ s  preferences  for 
different  levels  of  the  attribute 
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Glossary  (contd) 


mutual  preferential  independence  -  a  condition  where  all  subsets  of 
the  attributes  set  are  preferentially  independent  of  their 
complements. 


node  -  an  element  of  the  objective  hierarchy. 


node  digit  -  the  number  stating  the  position  of  a  node  on  its  span.' 

(AAS  has  node  digit  2,  AA  has  node  digit  1,  AACA  has  node 
digit  1 ) . 


node  reference  number  (NRN)  -  the  vector  which  draws  a  path  from  the 
root  node  to  a  given  node.  Each  node  has  a  unique  NRN. 
Each  element  of  a  NRN  is  a  node  digit.  (AAAA  has  NRN  = 
1.1. 1.1,  AACA  has  NRN  =  1.1. 3.1,  AB  has  NRN  =  1.2). 


ncn  redundancy  -  the  attributes  should  be  defined  to  avoid  double  count¬ 
ing  of  consequences. 


objective  -  an  entity  which  indicates  the  "direction"  in  which  to 
strive. 


operational  -  the  attributes  must  be  meaningful  to  the  DM.  They  should 
also  facilitate  exDlanation  to  others. 


pairwise  preferential  independence  -  that  condition  each  pair  of.  attri¬ 
butes  is  preferentially  independent  of  its  complement. 


parent  node  -  the  node  directly  in  line,  one  level  above  a  given  node. 

(A  is  the  parent  of  AA  and  AB;  AA  is  the  parent  of  AAA,  AAB 
and  AAC) . 


preferential  independence  -  a  condition  where  the  preferences  over  a 
subset  of  the  attributes  are  independent  of  the  level  of 
the  remaining  attributes. 


proxy  attribute  -  one  that  reflects  the  degree  to  which  an  associated 
objective  is-met,  but  does  not  directly  measure  the  objec- 
.  tive. 


Glossary  (contd) 


relative  weight  -  the  importance  of  a  node  relative  to  its  siblings. 
They  are  positive  and  normalized  to  sum  to  unity.  • 

root  (root  node)  -  the  topmost  node  in  a  hierarchy,  representing  the 
overall  objective- of  the  hierarchical  structure. 


sibling  -  those  nodes  which  have  the  same  parent  node.  (AA  and  AB  are 
siblings;  AAA  and  AAB  and  AAC  are  siblings). 


span  -  a  set  of  siblings.  (AA  and  AB  comprise  a  span). 

specification  -  subdividing  an  objective  into  lower  level  objectives  of 
more  detail . 


strategic  equivalence  -  the  value  functions  v-|  and  are  strategically 
equivalent  (v^  'v  v?)  if  v^  and  v^  have  the  same  indifference 
curves  and  induced  preferential  ordering. 


value  -  the  worth  of  a  level  of  a  particular  attribute  for  a  given 
alternative  under  conditions  of  certainty. 
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OVERVIEW 


MADAM  is  a  computer  based  decision  support  aid.  It  is  designed  to 
test  the  conditions  necessary  and  sufficient  to  utilize  a  MAUT  analysis 
with  an  additive  decomposition  for  the  value  function.  If  these  condi¬ 
tions  are  satisfied  then  a  decision  analysis  under  certainty  is  completed 
with  a  sensitivity  analysis.  MADAM  is  written  in  FORTRAN  V  and  is  cur¬ 
rently  implemented  on  the  CYBER  175  system.  It  is  run  interactively  and 
memory  requirements  are  a  function  of  the  size  of  the  problem.  The  user 
should  refer  to  Chapter  V:  An  Illustrative  Example  (of  the  main  text) 
to  see  how  these  options  appear  for  a  sample  output.  Note  that  the  fol¬ 
lowing  description  only  show  those  outputs  which  require  an  input  (prompts). 
By  comparing  the  descriptions  of  this  appendix  with  the  sample  output  of 
Chapter  V  of  Volume  I,  it  is  possible  to  see  the  other,  informative  out¬ 
put  which  the  program  provides. 
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I.  CAPABILITIES  AND  LIMITATIONS 

MADAM  is  capable  of  handling  a  full  decision  analysis  for  a  hierar¬ 
chical  problem  which  satisfies  the  conditions  for  an  additive  decomposi¬ 
tion  (MAUT)  under  certainty.  The  analysis  is  freely  structured  in  that 
it  allows  the  user  to  interactively  input  the  objective  hierarchy,  the 
attribute  set,  the  alternative  set,  relative  weights,  and  attribute  levels 
via  the  program  options.  The  interactive  program  uses  line  printer  style 
intermediate  graphics  to  aid  the  user  in  input,  and  a  separate  program 
converts  the  data  structure  into  a  separate  plot  file  which  is  device 
independent  and  can  be  used  to  generate  hard  copy  graphics  (or  reviewed 
at  a  graphics  terminal).  MADAM  automatically  calculates  the  overall  value 
of  each  of  the  alternative  systems  at  the  root  node  as  well  as  intermedi¬ 
ate  values  at  all  other  nodes  in  the  objective  hierarchy.  Data  is  both 
graphical  and  tabular  in  format,  and  the  user's  option.  An  emphasis  has 
been  made  in  keeping  MADAM  as  machine  independent  as  possible  so  that  it 
may  be  used  on  any  computer  with  a  minimum  of  changes. 

One  of  the  most  significant  advantages  of  MADAM  (or  any  real-time 
decision  aid)  is  the  powerful  capabilities  of  the  sensitivity  analysis. 

Although  MADAM  may  be  applied  to  a  wide  variety  of  problems,  there 
are  limitations  which  must  be  considered.  One  of  the  most  basic  limita¬ 
tions  is  that  MADAM  may  be  used  only  for  problems  which  can  be  represent¬ 
ed  as  a  hierarchical  objective  structure.  There  are  situations  where  it 
would  be  meaningless  to  take  such  an  approach.  For  those  , problems  which 
are  suitable  for  a  MAUT  approach,  only  those  cases  which  involve  the 
additiv.e  decomposition  may  be  fully  explored  by  using  MADAM.  Although 
the  necessary  and  sufficient  conditions  for  using  the  attribute 
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decomposition  are  ascertained,  MADAM  is  not  currently  designed  to  handle 
other  forms  of  the  value  function  for  those  situations  where  the  condi¬ 
tions  do  not  hold.  Finally,  there  are  operational  limitations  on  the 
size  of  the  problem  based  on  arbitrary  choice  of  parameters  (see  Table 
B.l).  Most  of  these  limitations  may  be  removed  by  modifying  the  program 
code.  Further  details  are  provided  in  the  Programmer's  Manual. 


Maximum: 


Number  of  Nodes  500 
Number  of  Levels  20 
Number  of  Alternative  Systems  59 
Number  of  Nodes  on  a  Span  9 
Data  Sets  (single  session)  3 


Table  B.l  Operational  Limitations 


II.  INPUT 


In  this  context,  input  refers  to  all  data  used  in  running  the  program. 
This  data  is  obtained  either  from  interactive  user  responses  to  questions 
or  from  previously  generated  and  stored  data  files.  Anytime  that  a  user 
response  is  required  to  generate  data,  a  prompting  question  is  displayed. 

A  question  mark  appears  either  at  the  end  of  the  question  or  at  the  be¬ 
ginning  of  the  line  following  the  prompt.  No  other  type  of  output  re¬ 
quired  (or  accepts)  a  response  from  the  user. 

Program  Control 

The  flow  of  the  program  is  controlled  by  user  responses,  to  prompts 
or  by  user  selection  of  a  main  option.  Selections  are  made  in  one  of 
three  ways:  (1)  using  a  three  character  code  concluded  by  a  RETURN,  (2) 
using  a  single  letter  followed  by  RETURN,  or  (3)  entering  "Y"  or  "N"  fol¬ 
lowed  by  a  RETURN.  The  type  of  response  required  is  self  evident  from 
the  prompt,  which  usually  displays  the  alternative  entries.  Most  of  the 
routines  have  fail-safe  mechanisms  to  allow  graceful  recovery  from  a  mis¬ 
taken  entry.  The  user  should  note,  however,  that  the  data  file  is  stored 
only  if  the  program  is  exited  normally  (option  ***D0N***). 

Conventions 

For  clarity,  all  computer  input  and  output  is  capitalized,  except 
for  output  variable  values,  alternative  listings,  and  node  reference  num¬ 
bers  which  are  delineated  by  <•;>. 

Terminology 

The  program  and  manuals  use  terminology  specific  to  tree  structures 
and  data  structures.  Appendix  A  should  provide  a  concise  reference  for 
unfamiliar  or  unique  words  and  phrases. 
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I H .  PROGRAM  FLOW 


K.J 


At  the  initiation  of  the  program,  a  very  brief  introductory  routine 
is  invoked  which  will  prompt  the  user  to  enter  his/her  name.  The  purpose 
of  this  is  two  fold.  First,  the  user's  name  is  an  element  of  several 
questions  in  order  to  emphasize  the  personal  nature  of  the  preference 
data.  Second,  for  those  situations  where  more  than  one  DM  may  wish  to 
compare  analyses,  it  provides  readily  available  information  as  to  what 
data  is  attributable  to  each  DM.  MADAM  is  designed  to  facilitate  partial 
analysis  of  the  problem  while  storing  data.  That  is,  it  is  possible  to 
use  MADAM  to  construct  the  objective  hierarchy,  attribute  set,  and  al¬ 
ternative  set,  and  then  to  store  this  data  while  the  DM  acquires  the  re¬ 
quired  information  concerning  attribute  levels.  The  user  may  call  up 
the  stored  information  and  continue  the  decision  analysis  from  that  point. 

If  a  new  data  file  is  to  be  constructed,  the  next  option  to  be  used 
is  option  ***NEW***.  The  option  automatically  takes  the  user  through 
options  ***SYS***,  ***JTL***,  ***SPA***,  and  ***ATT***  in  order  to  enter 
the  alternative  systems,  the  objective  hierarchy  and  the  attribute  set 
respectively.  If  a  previously  stored  data  file  is  to  be  used,  option 
***SEL***  instead  of  ***NEW***  should  be  called.  This  allows  the  user 
to  pick  the  stored  data  file,  but  then  returns  to  the  main  options,  where 
the  user  may  choose  the  entry  option. 

-  Under  the  ***$YS***  the  user  is  allowed  to  enter  the  alternative 
systems  to  be  compared.  At  least  one  system  must  be  entered  at  this 
point.  If  any  changes  to  this  alternative  set  must  be  made  after  leav¬ 
ing  this  option,  these  changes  may  be  implemented  by  invoking  ***SYS*** 
from  the  main  option  selection. 
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Option  ***TTL***,  which  is  automatically  entered  when  using  option 
***NEW***,  allows  the  user  to  enter  a  descriptive  title  for  the  data 
structure.  This  title  appears  as  a  header  for  the  output  when  using  the 
***REV***  or  ***NUM***  options.  The  title  should  contain  information  such 
as  name,  date,  subject,  requesting  source,  and  any  other  data  useful  in 
identifying  the  data  structure. 

The  ***SPA***  option  allows  the  user  to  construct  the  objective  hi¬ 
erarchy.  The  tree  is  entered  on  a  node  by  node  basis  using  a  depth-first 
approach.  If  changes  are  necessary  during  the  construction,  the  user  is 
automatically  sent  to  the  appropriate  routine  (MODIFY,  PRUNE)  and  then 
brought  back  to  the  ***SPA***  option.  Later  changes  to  the  tree  structure 
(after  leaving  ***SPA***)  are  possible  through  the  use  of  ***M0D***  or 
***Prij***.  At  the  conclusion  of  ***SPA***  the  data  file  is  closed  and 
then  reopened.  This  ensures  that  the  data  generated  up  to  this  point  is 
not  lost  in  the  event  that  the  program  exits  abnormally  (crashes). 

The  ***ATT***  option  involves  construction  of  the  attribute  set.  As 
each  data  node  is  encountered  in  a  depth-first  search,  the  user  is  solic¬ 
ited  for  information  about  an  attribute  to  be  associated  with  that  objec¬ 
tive.  The  program  checks  the  attributes  for  PPI.  If  PPI  holds,  the 
individual  value  functions  will  be  stored  for  each  attribute. 

At  this  point,  the  user  is  returned  to  the  main  option  selection. 

The  option  ***WVC***  should  be  invoked  in  order  to  enter  the  node  weights, 
the  attribute  levels,  and  to  calculate  the  tree.  The  input  weights  are 
either  directly  entered  as  ratios  (they  will  be  normalized  automatically) 
or  by  a  pairwise-comparison  technique.  After  entering  the  weights  and  . 
attribute  levels,  the  tree  values  are  calculated.  Calculations  is  man-  . 
datory  before  any  output  is  used  or  any  sensitivity  analysis  conducted. 
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If  at  any  time  changes  are  made  in  the  data  structure,  the  tree  must  be 
recalculated. 

At  this  point  the  program  is  able  to  provide  the  user  with  the  de¬ 
sired  output.  The  two  basic  options  for  review  are  ***NUM***  and 
***DIS***.  Option  ***NUM***  is  a  numerical  review  of  selected  nodes  in 
the  data  structure.  Along  with  relative  and  cumulative  weights  of  each 
node,  the  values  of  the  alternative  systems  at  that  node  are  presented. 
The  ***DIS***  option  reviews  only  a  single  node  and  its  descendants. 

This  option  allows  for  a  graphical  display  as  well  as  a  numerical  one. 

The  sensitivity  analysis  is  provided  by  the  main  option  ***SEN***. 
Current  options  for  the  sensitivity  analysis  allow  for  a  sensitivity 
analysis  on  cumulative  weight,  relative  weight,  or  attribute  level.  Also 
a  system  option  may  be  invoked  which  will  allow  the  analysis  to  cover 
several  chosen  nodes.  When  a  cumulative  weight,  relative  weight  or  attri 
bute  level  analysis  is  invoked  directly,  only  one  node  is  examined  and 
all  of  the  system  value  changes  are  relative  for  that  node.  V/hen  using 
the  system  suboption  and  then  using  a  cumulative  weight,  relative  weight, 
or  value  analysis,  only  one  system  is  considered,  but  system  values  are 
given  relative  to  a  set  of  nodes.  These  options  are  more  explicitly  de¬ 
scribed  in  the  sensitivity  analysis  section  (Chapter  IV)  of  the  main  text 
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IV.  MAIN  OPTIONS 


This  section  gives  a  detailed  description  of  each  of  the  main  op¬ 
tions.  The  options  are  presented  in  alphabetical,  rather  than  logical 
order  to  facilitate  referencing.  The  general  format  used  to  present 
each  option  is  given  in  Figure  B.l. 

OPTION:  (option  mnemonic ) (option  name) 

USE:  A  general  discussion  of  the  use  of  the  option 

********************  CAUTION  ******************* 

CAUTION  ASSOCIATED  WITH  THE  USE  OF  THIS  OPTION 
********************  CAUTION-  ******************* 

PROMPT  or  MESSAGE  output  of  the  computer  which  will  require  a 
response 

SITUATION  describes  the  meaning  of  the  prompt  and  the 

implications  of  some  responses 

RESPONSE  acceptable  responses  to  the  prompt 

This  PROMPT-SITUATION-RESPONSE  is  repeated  as  often  as 
necessary 

Figure  B.l  Option  Discussion  Format 

Each  of  these  responses  must  be  followed  by  a  carriage  return. 


137 


MAIN  OPTION  SELECTION 


PROMPT:  cuser  name>,  YOUft  OPTIONS  ARE: 

ATT,  OIS,  DON,  MOD,  NEW,  NUM ,  PRU,  REV,  SEL 

SEN,  SPA,  STA,  SYS,  TTL,  WVC 

***NOTE:  IF  YOU  NEED  AN  EXPLANTION,  <user  name> 

TYPE  "HELP"  *** 

WHAT  IS  YOUR  CHOICE,  <user  name> 

SITUATION:  After  the  introduction  or  the  conclusion  of  a  main  option, 
the  user  is  transferred  to  this  selection  routine.  From 
here,  the  user  may  enter  any  of  the  main  options.  Use  of 
HEL  or  HELP  will  elicit  a  brief  description  of  each  of  the 
main  options.  Entering  an  illegitimate  entry  will  cause 
ar.  error  message  and  this  prompt  to  be  repeated. 

RESPONSE:  HELP  or  a  three  letter  main  option. 
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OPTION:  ATT  (ATTribute) 


USE:  This  option  is  used  to  enter  the  attributes  which  will  be 
associated  with  the  tree  structure.  It  is  automatically 
invoked  when  using  option  ***NEW***.  It  may  be  used 
directly  to  alter  the  existing  data  structure 

****************  CAUTIONS  *************** 

1 .  ALL  EXISTING  ATTRIBUTE  INFORMATION  WILL  BE  OVERWRITTEN  IF  THIS 
OPTION  IS  USED  (FOR  THE  CURRENT  TREE  FILE). 

2.  BY-PASSING  THE  INDEPENDENT  TESTING  IS  NOT  ALLOWED  IF  NUMERICAL 
INFORMATION  IS  TO  BE  GENERATED  (THE  VALUE  FUNCTIONS  WILL  BE 
ILL  DEFINED). 

****************  CAUTIONS  *************** 

PROMPT-1:  <user  name> ,  PLEASE  INPUT  AN  ATTRIBUTE  FOR  THE 

DATA  NODE  WITH  THE  OBJECTIVE: 

<objective> 

(10  LETTERS  OR  LESS) 

SITUATION:  MADAM  is  prepared  to  accept  an  attribute  to  be 

associated  with  the  given  data  node.- 

RESPONSE-1:  Enter  a  10  (or  less)  letter  mnemonic  for  the 
desired  attribute 

LJ  PROMPT-2:  IS  THE  ATTRIBUTE  <attribute> 

SUCH  THAT  BY  KNOWING  ITS  LEVEl ,  . 

THE  ATTAINMENT  OF  THE  OBJECTIVE 
IS  TOTALLY  DETERMINED?  (Y/N) 

? 

SITUATION:  Desirability  of  the  attribute  is  being  tested.  If  no, 

prompt-1  will  be  repeated. 

RESPONSE-2:  Y  or  N 

PROMPT-3:  COULD  THE. ATTRIBUTE  <attribute> 

BE  CHANGED  SO  AS  TO  IMPROVE 
COMMUNICATING  WHAT  IS  IMPLIED 
BY  THE  OBJECTIVE?  (Y/N) 

? 

SITUATION:  The  attribute  is  being  tested  for  desirability 

A  negative  response  will  generate  a  repeat  of 
prompt-1 . 

RESPONSE-3:  Y  or  N 

PROMPT-4:  WHAT  IS  THE  WORST  ACCEPTABLE 

LEVEL  (REAL  NUMBER)  OF  <attribute> 

SITUATION:  A  lower  bound  on  this  attribute  is  sought. 

RESPONSE-4.  Enter  a  real  number 
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PROMPT-5:  WHAT  IS  THE  BEST  (REALISTICALLY)  LEVEL 

(REAL  NUMBER)  OF  <attributes>,  <usur  name>? 

SITUATION:  Ar.  upper  bound  on  this  attribute  is  sought. 

RESPONSE-5:  Enter  a  real  number 

[The  process  is  repeated  from  prompt-1  until  all  data  nodes 
have  been  associated  with  an  attribute.] 

PROMPT-6:  DO  YOU  WISH  TO  REFORM  THE  ATTRIBUTE  SET,  <user  name>? 

(Y/N)  ? 

SITUATION:  The  overall  attribute  set  is  being  established  as 

appropriate  for  the  analysis.  A  negative  response 
reinitializes  ***ATT***. 

RESPONSE-6:  Y  or  N 

PROMPT-7;  DO  YOU  WISH  TO  BYPASS  INDEPENDENCE  TESTING? 

SITUATION:  MADAM  is  determining  if  the  user  wishes  to  skip 

PPI  testing.  Any  response  besides  Y  will  be 
interpreted  as  a  negative  answer. 

RESPONSE-7:  Y  or  any  letter  /' 

/ 

/ 

/ 

[If  response-7  is  a  Y,  control  goes  directly  to  the  routine 
which  input  value-functions  (see  prompt-13).  Otherwise, 
the  following  analysis  is  generated.] 

PROMPT-8:  AT  WHAT  TOLERANCE  DO  YOU  WANT  TO  CHECK  YOUR 

RESPONSES,  <user  name>  (PLUS  OR  MINUS  X  PERCENT)? 

X  =  ? 

SITUATION:  The  tolerance  window  for  PPI  testing  will  be  set  at 

+  X%  based  on  the  mid-range  of  the  attribute  levels. 
Two  digits  must  be  entered  (e.g.  05  means  5%). 

RESPONSE-8:  A  right- justified  two  digit  number 

PROMPT- 9:  WHAT  LEVEL  OF  <attribute>  WOULD  KEEP  YOU  AS  SATISFIED 

AS  YOU  WERE  UNDER  THE  INITIAL  CONDITIONS? 

(REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT  THE  25 
PERCENT  LEVEL) 

? 

SITUATION:  An  indifference  curve  is  being  established. 

RESPONSE-9 :  Any  real  number 

•  PROMPT-1 0 :  TO  WHAT  LEVEL  WOULD  YOU  CHANGE  <attribute>,  IN  ORDER 
TO  REMAIN  AS  SATISFIED  AS  YOU  WERE  INITIALLY? 
(REMEMBER  THAT  ALL  OTHER  ATTRIBUTES  ARE  AT  THE  25 
PERCENT  LEVEL) 

? 

SITUATION:  An  indifference  curve  is  bcv'.g  established. 
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RESPONSE-10:  Any  real  number 

PROMPT-11:  WOULD  THE  LEVEL  OF  <attribute>  NEEDED  TO  REMAIN  AS 

SATISFIED  AS  AT  THE  INITIAL  CONDITIONS  LIE  BETWEEN 
<number>  AND  <number> 

(Y/N)  ? 

SITUATION:  MADAM  is  testing  for  shifts  in  the  indifference  curve 

based  on  changing  the  background  attributes. 

RESPONSE-11:  Any  real  number 

PROMPT-12:  WOULD  THE  LEVEL  OF  <attribute>  THAT  YOU  WOULD 

HAVE  TO  MOVE  TO  f IN  ORDER  TO  BE  AS  SATISFIED  AS 
UNDER  THE  INITIAL  CONDITIONS)  LIE  BETWEEN  <number> 

AND  <number> 

(Y/N)  ? 

SITUATION:  MADAM  is  testing  for  shifts  in  the  indifference  curve 

based  on  changing  the  background  attributes. 

RESPONSE-12:  Any  real  number 

[Prompts  9-12  are  repeated  for  all  pairs  of  atributes. 

These  pairs  are  generated  based  on  the  order  in  which  the 
attributes  were  entered.  The  pairs  tested  are  ATT1-ATT-2, 
ATT1-ATT3, . . . ,  ATT! ,  ATTn,  ATT2-ATT3,  etc.] 

PROMPT-13:  DO  YOU  WISH  TO  ASSUME  PPI  FOR  THE  REMAINING 

ATTRIBUTES?  (Y/N) 

SITUATION:  Independence  testing  between  a  particular  pair  of 

attributes  has  been  completed.  There  have  been  no 
independence  problems  so  far,  and  the  user  may  now 
by-pass  the  remaining  independence  testing. 

RESPONSE-13:  Y  or  N 

PROMPT-14:  EVEN  IF  YOU  DO  NOT  WISH  TO  ASSUME  PPI  AMONG  THE 

REMAINING  ATTRIBUTES,  DO  YOU  WANT  TO  STOP  PPI 
TESTING?  (Y/N) 

SITUATION:  The  answer  to  prompt-14  was  N. 

RESPONSE-' 4:  i  or  N 

PROMPT-15:  THERE  ARE  INDEPENDENCE  PROBLEMS  AMONG  THE  ATTRIBUTES 

ALREADY  TESTED.  DO  YOU  WANT  TO  STOP  PPI  TESTING? 
(Y/N) 

SITUATION:  Analogous  to  prompt  -14  except  that  independence 

problems  have  been  established. 


RESPONSE-15:  Y  or  N 


PROMPT-16:  THERE  EXIST  INDEPENDENCE  PROBLEMS  AMONG  THE 

ATTRIBUTES  (PPI  DOES  NOT  HOLD).  DO  YOU  WISH  TO 
CONTINUE  THE  ANALYSIS  WITH  AN  ADDITIVE  VALUE 
FUNCTION?  (Y/N) 

? 

SITUATION:  Significant  shifts  in  the  indifference  curves  were 

found  when  the  background  attributes  were  shifted. 

The  user  may  desire  to  reformulate  the  problem  rather 
than  continue  with  the  analysis  with  the  incorrect 
additive  form  of  the  value  function. 

RESPONSE-16:  Y  or  N 

PROMPT-17;  WHAT  LEVEL  OF  <attribute>  WOULD  BE  SUCH  THAT  YOU 

WOULD  FEEL  THE  SAME  AMOUNT  OF  CHANGE  IN  SATISFACTION 
IN  MOVING  FROM  <number>  TO  IT,  AS  FROM  THAT  LEVEL  TO 
<number>? 

SITUATION:  MADAM  is  establishing  the  form  of  the  value  function. 

This  prompt  is  repeated  three  times. 

RESPONSF-17 :  Any  real  number 

PROMPT-18:  DOES  THE  ABOVE  REPRESENTATION  APPEAR  REASONABLE?  (Y/N) 

? 

SITUATION:  The  user  is  asked  to  validate  the  generated  value 

function  based  on  curvature  and  levels. 

RESPONSE-18:  Y  or  N 


[Prompts  17-18  are  repeated  for  all  attributes.] 


OPTION:  COP  (COPy) 


USE:  This  option  is  used  to  copy  the  descendant  structure  of  one 
node  onto  a  second  node.  Copying  includes  all  information 
contained  in  the  children  of  the  time  of  copying. 

★***★★★**★★*★**  CAUTIONS  *************** 

1 .  THE  NODE  BEING  COPIED  TO  MUST  N0_T  BE  A  DESCENDANT  OF  THE 
NODE  BEING  COPIED. 

***************  CAUTIONS  *************** 

PROMPT-1:  ENTER  NODE  TO  BE  COPIED  TO. 

ENTER. ..NRN’ 

SITUATION:  The  user  is  asked  to  enter  the  node  reference 

number  of  the  node  which  will  gain  the  descendants. 
Entering  an  invalid  node  reference  number  will  abort 
the  option. 

RESPONSE-1:  Enter  a  NRN  followed  by  0,  each  digit  followed  by  <cr> 

PROMPT- 2:  ENTER  NODE  TO  BE  COPIED. 

ENTER... NRN? 

SITUATION:  The  user  is  asked  to  enter  the  parent  of  the 

descendants  which  are  to  be  copied.  All 
descendants  of  the  parent  node  will  be  copied. 

An  invalid  node  will  abort  cop. 

RESPONSE-2:  Enter  a  NRN  followed  by  0,  each  digit  followed  by  <cr> 


OPTION:  DIS 


a 

USE:  The  routine  allows  display  of  a  desired  node  and  its 

children.  This  option  has  no  caution^  associated  with  it. 

PROMPT-1:  ENTER  NODE  TO  BE  DISPLAYED. . . 

ENTER... NRN? 

SITUATION:  MADAM  is  ready  to  display  the  node  associated  with 

the  input  NRN. 

RESPONSE-!:  Enter  the  desired  NRN  one  digit  at  a  time  with  each 

digit  followed  by  a  <cr>.  End  the  input  by  entering 
a  0  followed  by  <cr>. 

NODE  IS  A  DATA  NODE  AND  CANNOT  BE  DISPLAYED 
(PRESS  ANY  LETTER  TO  CONTINUE) 

? 

The  input  NRN  was  associated  with  a  data  node  (a 
node  with  no  descendants).  This  type  of  node  cannot 
be  displayed.  Prompt-1  will  be  repeated. 

RESPONSE-1  a:  Enter  any  letter 

PROMPT-2:  IF  ANY  MODIFICATIONS  HAVE  BEEN  MADE  TO  THE  TREE 

SINCE  IT  HAS  BEEN  CALCULATED,  NUMERICAL  VALUES 
WILL  BE  INCORRECT. 

(PRESS  ANY  LETTER  TO  CONTINUE) 

? 

SITUATION:  MADAM  is  presenting  a  warning  in  case  the  user 

neglected  to  recalculate  the  tree  after  modifying 
it. 


PROMPT-1  a: 
SITUATION: 


RESPONSE-2:  Enter  any  letter 


OPTION:  DON  (DONe) 

USE:  This  is  the  last  option  used.  This  signals  the  program  to 
end  and  to  save  the  data.  The  data  files  will  be  stored 
as  local  files.  There  are  no  cautions  or  prompts  associated 
with  this  option.  Tape  files  must  be  converted  to  permanent 
files  before  logging-out.  For  the  CYBER  175  system,  the 
procedure  is  as  follows: 

COMMAND  -  REQUEST,  A,  *PE 

COMMAND  -  REWIND,  TAPE"  1,  A 

COMMAND  -  COPY,  TAPE  1 ,  A 

COMMAND  -  CATALOG,  TAPE  1,  <pfname>,  RP=999 

This  will  store  a  local  file  TAPE  1  on  to  a  permanent  file 
<pfname>.  Each  tree  file  number  (m)  will  produce  a  local 
file  TAPE  n. 

This  stored  file  may  be  retrieved  by  using: 

COMMAND  -  ATTACH,  TAPE  1,  <pfname> 

NOTE:  Use  the  same  tape  number  as  tree  file  number. 

A  preferred  alternative  to  the  above  (due  to  file  size)  is 
to  use  the  indirect  file  library  system.  To  use  this,  the 
following  commands  are  invoked: 

COMMAND  -  ATTACH,  ZZZZZLB,  IFSLIB,  PW-TKIFS,CY=999, 
ID=A81 01 71 ,  SN  =  ASD 
COMMAND  -  LIBRARY,  ZZZZZLB. 

The  very  first  time  this  library  is  used,  the  command  entered 
is  BUILD.  For  all  subsequent  uses,  this  is  not  done.  Files 
are  saved  by  using  SAVE,  TAPEn  or  REPLACE,  TAPEn  (in  the  case 
of  a  previously  stored  file).  The  files  are  accessed  by  the 
command  GET,  TAPEn.  Just  before  logging  out,  the  REORG  command 
should  be  invoked. 
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OPTION:  HELP  (HELp) 

USE:  This  option  is  designed  to  aid  the  user  in  choosing  a  main 
option.  It  lists  a  brief  description  of  each  of  the  main 
options.  There  are  no  cautions  associated  with  this  option. 

PROMPT - 1 :  (PRESS  AMY  LETTER  TO  CONTINUE) 

SITUATION:  Approximately  a  screenful  of  information  has  been 

displayed,  and  the  program  is  pausing  to  allow  the 
user  to  assimilate  the  information  before  continuing 
the  listing. 

RESPONSE-1:  Press  any  letter  and  then  a  carriage  return 


OPTION:  MOD  (MOP4  fy) 

USE:  This  option  is  used  to  modify  the  existing  tree  structure 
one  node  at  a  time.  Each  node  input  is  either  created 
with  necessary  predecessor  or  the  existing  objective  is 
changed  if  the  node  already  exists. 

***************  CAUTIONS  ************* 

1.  ALL  NRN'S  ENTERED  MUST  HAVE  A  FIRST  DIGIT  OF  1.  USE  OF  ANY 
OTHER  PRIMARY  DIGIT  WILL  CAUSE  A  LOSS  OF  TREE  STRUCTURE. 

2.  EXCEEDING  THE  LIMIT  OF  9  DESCENDANTS  ON  EACH  NODE  WILL  HAVE 
UNPREDICATABLE  RESULTS. 

3.  A  DIGIT  OF  1  SHOULD  BE  USED  IN  THE  NRN  OF  THE  PLACE 
CORRESPONDS  TO  A  NON-EXISTING  SPAN. 

4.  OVERALL  TREE  SIZE  LIMITATIONS  MAY  NOT  BE  EXCEEDED. 

***************  CAUTIONS  *************** 

PROMPT-1:  ENTER... NRN? 

SITUATION:  The  user  is  asked  to  enter  the  node  reference  number 

of  the  node  to  be  added  or  the  objective  to  be  changed. 
Entering  a  0  <cr>  will  return  control  to  the  calling 
routine . 

RESPONSE-1:  Enter  the  desired  NRN  subject  to  the  above  cautions. 

PROMPT-2:  ENTER  YOUR  NEW  OBJECTIVE 

? 

SITUATION:  The  user  is  asked  to  associate  an  objective  with  the 

modified  or  added  node.  Entering  a  null  string  will 
abort  the  option.  Control  will  be  returned  to  the 
calling  routine.  If  response-2  is  not  a  null-string, 
prompt-1  will  be  repeated. 

RESPONSE-2:  Enter  an  objective  of  less  than  two  80  character 

lines  in  length  (use  a  carriage  return  between  lines 
or  a  null  string. 


OPTION:  NEW  (NEW  data  file) 


USE:  This  option  is  used  to  generate  a  new  tree  structure 
either  in  a  newly  created  file  or  by  over  writing  an 
existing  file. 

***************  CAUTIONS  **************** 

1 .  CHOOSING  A  TREE  FILE  NUMBER  WHICH  HAS  PREVIOUSLY  STORED 
DATA  WILL  CAUSE  THE  STORED  DATA  TO  BE  LOST. 

**★***★★**★*★*★  CAUTIONS  **************** 

PROMPT-1:  WITH  WHICH  TREE  WOULD  YOU  LIKE  TO  WORK,  <user  name>? 

SITUATION:  MADAM  is  allowing  the  user  to  specify  which  of  the  three 

tree  files  is  to  be  the  current  work  file. 

RESPONSE-1:  1,2,  or  3 

PROMPT-2:  OPENING  FILE  NUMBER  <number> 

IS  THIS  DATA  NEW  (N)  OR  STORED  (S)? 

SITUATION:  MADAM  is  ascertaining  whether  or  not  this  file  contains 

previously  stored  data.  A  response  of  "N"  causes  the 
file  to  be  blanked  out  (initialized).  A  response  of 
"S"  allows  the  user  to  continue  with  option  ***NEW*** 
only  if  the  number  of  nodes  is  zero.  This  latter 
situation  occurs  if  the  user  has  previously  answered 
this  question  with  a  "N"  for  this  file  number. 

RESPONSE-2:  "N"  or  "S" 

See  option  ***SYS*** 

See  option  ***TTL*** 

See  option  ***SPA*** 

See  option  ***ATT*** 

(Control  is  returned  to  main  option  selection.  The  next 
main  option  selected  should  be  ***WVC***). 


OPTION:  NUM  (NUMerica1  review) 


USE:  This  option  is  used  to  review  the  objective  hierarchy 
one  node  at  a  time.  This  option  is  similar  to 
***REV***  but  it  includes  numerical  values  at  the  node. 

***************  CAUTIONS  **************** 

1  .  THIS  ROUTINE  MUST  BE  EXITED  AFTER  THE  LAST  NODE  (DEPTH- 
FIRST  ORDERING)  IS  REVIEWED. 

***************  CAUTIONS  **************** 

PROMPT-1:  HOW  MUCH  DO  YOU  WANT  TO  REVIEW... 

A)LL  S ) EL  ECT 
? 

SITUATION:  MADAM  is  preset  at  this  point  to  review  the  entire 

hierarchy  starting  at  the  root  node.  A  response  of 
"A"  begins  this  review.  A  response  of  "S"  results 
in  prompt-la. 

RESPONSE-!:  "A"  or  "S" 

PROMPT-1  a:  ENTER  NRN. . . ? 

SITUATION:  MADAM  is  prepared  to  begin  the  review  at  any  nod 

which  is  desired.  Input  of  a  null  string  or  invalid 
NRN  causes  the  full  review  to  be  initiated. 

RESPONSE-! a:  NRN  followed  by  0  each  digit  followed  by  <cr> 
or  null  string. 

PROMPT-2:  IF  AMY  MODIFICATIONS  HAVE  BEEN  MADE  TO  THE  TREE 

SINCE  IT  HAS  BEEN  CALCULATED,  NUMERICAL  VALUES  WILL 
BE  INCORRECT. 

(PRESS  ANY  LETTER  TO  CONTINUE) 

? 

SITUATION:  MADAM  is  presenting  a  standard  warning  in  case  the 

user  failed  to  recalculate  the  tree.  The  option 
still  continues  even  if  values  are  incorrect. 

RESPONSE-a:  Any  letter 

PROMPT-3:  (PRESS  ANY  LETTER  TO  CONTINUE  (EXCEPT  "E") 

(PRESS  "E"  TO  EXIT) 

1 

SITUATION:  MADAM  has  finished  reviewing  the  current  node  and 

is  prepared  to  either  review  the  next  (depth-first 
order)  node  or  to  return  control  to  the  main  option 
selection. 

RESPONSE-3:  Any  letter  of  "E" 
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OPTION:  PRU  (PRUne  nodes) 

USE:  This  option  is  used  to  eliminate  an  undesired  node  from 
the  tree.  It  is  entered  automatically,  if  needed,  from 
***SPA***  or  ***NEW***.  It  can  be  invoked  directly. 


*************** 


CAUTIONS  *************** 


MODIFICATION  TO  DATA  STRUCTURE  ARE  PERMANENT.  TEMPORARY 
"PRUNING"  MAY  BE  DONE  BY  ENTERING  A  RELATIVE  WEIGHT  OF  ZERO 
IN  THE  ***WVC***  OPTION 

***************  cautions  *************** 


ENTER  NODE  TO  BE  REMOVED. 

ENTER  NRN. . . ? 

MADAM  is  preparing  to  prune  the  hierarchy.  If  che 
user  does  not  wish  to  continue  with  this  option, 
enter  an  invalid  NRN  (see  prompt-la). 


PROMPT- 1 : 
SITUATION : 


RESPONSE-!:  Enter  NRN  followed  by  "0"  each  digit  followed  by  <cr> 


PROMPT-1  a: 
SITUATION: 


RESPONSE-1  a: 

PROMPT-?: 

SITUATION: 


RESPONSE-a: 
PROMPT- 3: 


SITUATION: 


RESPONSE-3: 


NODE  NOT  FOUND,  DO  YOU  WISH  TO  TRY  AGAIN?  (Y/N) 

NRN  entered  was  invalid.  A  negative  response 
returns  control  to  the  calling  routine.  A  positive 
response  results  in  a  repeat  of  prompt-1. 

"Y"  or  "N" 

SELECT  PRUNING  OPTION: 

N)ODE+DOWN  D)OWN  ONLY  S)ELECT  DOWN  E)XIT 
MADAM  is  prepared  to  remove  a  node(s). 

A  response  of  "N"  results  in  that  node  and  all  of  its 
descendants  being  ommitted. 

A  response  of  "D"  eliminates  only  the  descendants. 

A  response  of  "S"  results  in  prompt-3. 

A  response  of  "E"  returns  control  to  the  calling  routine, 

"N",  "D",  "S",  or  "E" 

<objective> 

WHICH  IS  CURRENT  DESCENDANT  NUMBER  <NRN  digit> 

DO  YOU  WISH  TO  ELIMINATE  THIS  DESCENDANT?  (y/N) 

MADAM  is  selecting  a  descendant  to  either  eliminate  or 
skip  over. 

"Y"  or  "N" 
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OPTION:  REV  (REView  hierarchy) 


USE:  This  option  is  used  to  review  the  objective  hierarchy  one  node 
at  a  time  (depth-first  order).  No  numerical  information  (except 
NRN)  is  provided.  This  option  has  the  same  cautions  and  prompts 
as  option  ***NUM***. 


OPTION:  IEL 


USE:  This  option  allows  the  selection  of  a  different  tree  number. 
The  prompts  and  cautions  are  like  those  of  option  ***NEW***. 
If  the  data  file  chosen  is  not  empty,  control  is  returned  to 
the  main  option  selection  rather  than  proceeding  with  option 
***NEW*** , 


•T 
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OPTION:  SEN  (SENsitivity  analysis) 

USE:  This  option  provides  a  sensitivity  analysis  of  the  model 
parameters.  There  are  no  cautions  associated  with  this 
option. 


PROMPT- 1 : 
SITUATION: 


RESPONSE-! : 
PR0MPT-2a: 

SITUATION: 


RESPONSES: 

PROMPT- 3a: 
SITUATION: 


RESPONSE- 3a: 

PR0MPT-2b: 

SITUATION: 

RESPONSES: 
PROMPT- 3b: 

SITUATION: 


CHOOSE  YOUR  OPTION: 

C)UMWT  R)ELWT  L ) EVEL  S)YSTEM  E)XIT 
MADAM  is  prepared  to  do  the  sensitivity  analysis  of 
the  user's  choice,  A  response  of  "C"  results  in  a 
direct  cumulative  weight  analysis.  A  response  of 
"R"  results  in  a  direct  relative  weight  analysis. 

"L"  results  in  an  attribute  level  analysis.  "$" 
results  in  a  system  analysis.  "E"  will  return  control 
to  the  main  option  selection.  Those  prompts  resulting 
from  "C",  "R",  or  "L"  are  given  a  postscript  'a'. 

Those  prompts  resulting  from  "S"  are  given  a  postscript 
'b'. 

C,  R,  L,  S,  and  E. 

ENTER  NRN  FOR  WHICH  <option>  IS  TO  BE 
PERTURBED... 

ENTER  NRN...? 

MADAM  is  prepared  to  run  a  direct  cumulative  weight, 
relative  weight,  or  attribute  level  analysis  at  the 
node  which  you  select.  An  attribute  level  analysis 
may  only  be  performed  at  a  data  node. 

Enter  NRN  followed  by  "0"  each  digit  followed  by  <cr> 

<options>  ANALYSIS:  TABULAR  GRAPHICAL  E)XIT 
MADAM  is  establishing  the  desired  output  format. 

"G"  results  in  prompt-7b,  8b.  "E"  returns  control 

to  main  option  selection.  "T"  repeats  this  prompt 
after  table  is  generated. 

"T",  "G"  or  "E" 

WHAT  SYSTEM  IS  TO  BE  ANALYZED? 

? 

After  displaying  the  alternative  systems,  the  user  is 
asked  which  system  will  be  the  one  of  interest. 

System  name 

WHAT  TYPE  OF  ANALYSIS  WOULD  YOU  LIKE  TO  DO... 

C)UMWT  R)ELWT  V)ALUE 
? 

MADAM  is  prepared  to  do  a  sensitivity  analysis  on  the 
system  entered  over  a  set  of  nodes.  A  response  of 
"C"  results  in  a  cumulative  weight  analysis.  "R" 
results  in  a  relative  weight  analysis.  "V"  results  in 
an  analysis  over  the  individual  attribute  level  value. 
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RESP0NSE-3b:  "C'1,  "R",  or  "V" 


PR0MPT-4b:  HOW  MANY  NODES  WOULD  YOU  LIKE  TO  EXAMINE?  (1-50) 

7 

SITUATION:  MADAM  is  preparing  to  store  the  node  set  over  which 

to  do  the  system  analysis. 

RESP0NS£-4b:  An  integer  between  1  ana  50  followed  by 
(use  two  digit  format  e.g.  2  — *  02) 

PR0MPT-5b:  ENTER  NP.N  FOR  WHICH  <option>  IS  TO  BE 

PERTURBED... 

ENTER  NRN. . .? 

SITUATION:  MADAM  is  storing  the  NRN 1 s  associated  with  the  nodes 

of  interest.  This  prompt  will  be  repeated  until  as 
many  nodes  as  were  specified  in  prompt-4b  are  stored. 

RESPQNSE-5b:  Enter  NRN  followed  by  0  each  digit 

PROMPT- 6b;  SYSTEM  ANALYSIS:  T)ABULAR  GRAPHICAL  E)XIT 

7 

SITUATION:  The  user  is  being  asked  for  the  desired  format.  "G" 

will  result  in  prompt-7b,  8b.  "E"  returns  control 

to  main  option  selection.  "T"  repeats  this  prompt 
after  table  is  generated. 

RESP0NSE-6b:  "T",  "G",  or  "E" 

PR0MPT-7b:  GRAPHICAL  ANALYSIS  N)0RMAL  E)XPANDED 

? 

SITUATION:  MADAM  is  asking  whether  the  overall  value  axis  should 

go  from  0-100  (normal)  of  from  lowest  to  highes 
computed  value  (expanded). 

RESP0NSE-7b:  "N\  or  "E" 

PR0MPT-8b:  (PRESS  ANY  LETTER  TO  CONTINUE) 

? 

SITUATION:  MADAM  is  done  with  graph.  Control  is  returned  to 

prompt-6a,  or  6b. 


RESP0N$E-8b:  Any  letter 


OPTION:  SPA  (SPArs  hierarchy) 


USE:  This  option  is  used  to  construct  an  objective  hierarchy. 
It  is  called  automatically  by  option  ***NEW***.  It  may 
be  invoked  directly. 


*************** 


*************** 


CAUTIONS 

1 .  ANY  PREVIOUS  DESCENDANTS  OF  A  NODE  ARE  LOST  IF  A  DESCENDANT 
IS  ADDED  TO  THE  NODE  OF  PREVIOUSLY  STORED  DATA  FILE.  TO 
ADD  NODES  TO  A  PREVIOUSLY  STORED  DATA  FILE.  TO  ADD  NODES 
TO  A  PREVIOUSLY  STORED  NODE,  WITH  OTHER  DESCENDANTS,  USE 
OPTION  ***ADD***. 

2.  A  MAX  OF  9  DESCENDANTS  FROM  ANY  NODE  IS  ALLOWED. 

***************  CAUTI'QNS  *************** 


PROMPT-1 : 
SITUATION: 

RESPONSE-1 : 


SPANNING  NODES:  A)LL  S)ELECT 
? 

MADAM  is  ready  to  start  building  the  objective 
hierarchy.  "A"  results  in  starting  to  build  at 
a  hidden  master  node  (first  node  entered  becomes 
the  root  node).  "$"  results  in  prompt  1-a. 


"A"  or  "S" 


PROMPT-1  a:  ENTER  NRN...? 

SITUATION:  MADAM  is  allowing  you  to  enter  the  node  which  will  be 

the  start  of  the  building  process, 

RESPONSE-la:  Enter  NRN  followed  by  "0”  each  digit  followed  <cr> 

PROMPT-2:  DO  YOU  WISH  TO  BUILD  A  NEW  TREE,  <user  name>?  (Y/N) 

SITUATION:  MADAM  is  giving  the  user  one  last  chance  to  exit  this 

option  without  changing  the  currently  stored  data  file, 
A  negative  response  will  return  control  of  the  program 
to  the  main  option  selection. 

RESPONSE-2:  "Y"  or  "N" 


PROMPT- 3: 
SITUATION: 


RESPONSE-3: 
PROMPT-4 : 


DO  YOU  WISH  TO  BYPASS  THE  BETWEEN  NODE  CHECK? 

MADAM  allows  the  user  to  examine  the  set  of  sub- 
objectives  entered  before  proceeding  to  the  next 
parent  node.  If  the  user  has  a  previously  constructed 
tree  or  time  constraints,  it  may  be  desirable  to  bypass 
the  review.  Only  a  response  of  "Y"  will  result  in  a 
bypass. 

"Y"  or  any  letter 

■<user  name>,  WHAT  IS  THE  NEXT  SUBOBJECTIVE? 

(USE  NO  MORE  THAN  TWO  80  CHARACTER  LINES) 


SITUATION: 


SITUATION:  MADAM  is  prepared  to  add  a  new  code.  If  an  entry 

is  desired,  any  non-blank  character  must  appear 
within  the  first  10  characters.  Entering  a  null 
string  will  cause  a  repeat  of  this  prompt  with  a 
new  parent  objective  if  the  response  to  prompt-3 
was  "Y",  otherwise  the  following  prompts  result. 
Entering  a  valid  string  causes  this  node  to  be 
generated.  This  prompt  is  repeated  with  the  same 
parent  node. 

RESPONSE-4:  Any  character  string  or  null  string 


PROMPT-5: 


SITUATION: 


RESPONSE-5: 


<user  name>,  00  THE  SUBOBJECTIVES  ADDRESS  ALL 

FACETS  OF  THE  PARENT  OBJECTIVE?  (Y/N) 

? 

The  response  to  prompt- 3  was  something  other  than  "Y" 
so  the  between  node  check  is  in  progress.  The  same 
situation  and  "Y"  or  "N"  response  is  for  prompts  5-8, 
so  they  will  not  be  repeated.  A  response  indicating 
a  problem  with  the  subobjective  results  in  the  automatic 
invocation  of  PRUNE  or  ADD  as  appropriate.  Control  is 
returned  to  prompt-5  if  this  occurs. 

"Y"  or  "N" 


PROMPT-6:  IS  THERE  ANY  OVERLAP  BETWEEN  THE  COVERAGES  OF  THE 

SUBOBJECTIVES,  <user  name>?  (Y/N) 

PROMPT-7:  <user  name>,  ARE  ALL  THE  SUBOBJECTIVES  OPERATIONALLY 

MEANINGFUL  TO  YOU?  (Y/N) 


PROMPT-8:  COULD  ANY  OF  THE  SUBOBJECTIVES  BE  IGNORED  WITHOUT 

SIGNIFICANTLY  IMPACTING  YOUR  PREFERENCES,  user  name  ? 


(At  this  point  control  is  returned  to  prompt-4  with  a  new  parent 
objective.  This  is  repeated  until  no  new  parents  exist.  Then 
control  is  returned  to  the  main  option  selection  if  ***SPA*** 
was  called  directly,  otherwise  control  is  shifted  to  option 
***ATT*** . 
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OPTION:  STA  (STAtus  of  hierarchy) 

USE:  This  option  is  used  to  check  how  many  nodes  are  being  used, 

how  many  levels  are  in  the  hierarchy,  and  how  many  alternative 
systems  are  in  memory.  Note  that  the  number  of  nodes  shown  by 
this  option  will  not  agree  one-for-one  with  size  of  the 
problem  at  hand,  but  will  reflect  internal  mechanisms  of 
MADAM.  Thus  it  is  this  number  of  nodes  rather  than  the 
problem  size  which  must  be  kept  under  500.  There  are  no 
cautions  or  prompts  associated  with  this  option.  Control  is 
returned  to  the  main  option  selection  if  ***STA***  is  called 
directly.  It  is  called  automatically  by  ***SPA***  if  the  be¬ 
tween  node  check  is  being  used. 


OPTION:  SYS  (SYStem  entry) 


USE:  This  option  is  used  to  enter  or  modify  the  list  of 
alternatives  under  consideration.  It  may  be  called 
directly.  It  is  called  automatically  when  using  ***NEW*** . 

***************  CAUTIONS  *************** 

1 .  AT  LEAST  ONE  SYSTEM  MUST  BE  ENTERED  BEFORE  MANY  OTHER 
OPTIONS  MAY  BE  USED. 

***************  CAUTIONS  *************** 

PROMPT-1:  YOU  ARE  AT  THE  POINT  WHERE  YOU  WILL  BE  ENTERING  THE 

ALTERNATIVE  SYSTEMS  WHICH  WILL  BE  RANKED  IN  TERMS 
OF  PREFERENCE.  PLEASE  CHOOSE  THE  APPROPRIATE  OPTION 
A)DD  D)ELETE  N)EW  E)XIT 

SITUATION:  MADAM  is  ready  to  deal  with  the  set  of  alternatives. 

Response  "N"  must  be  used  at  least  once  before  the 
other  responses  are  used.  Use  of  "E"  returns  con¬ 
trol  to  tne  calling  routine.  If  called  as  a  part 
of  ***NEW***  use  response  "N". 

RESPONSE-1:  "A",  "D\  "N\  or  "E" 

PR0MPT-2a :  ENTER  SYSTEM  <nsys->  LABEL... 

? 

SITUATION:  Response-1  was  "A".  MADAM  is  ready  to  add  a  new 

alternative  to  the  list.  Entering  a  null  string 
returns  control  to  prompt-1 .  Any  other  response 
repeats  prompt-2a  with  the  new  system  added. 

RESP0NSE-2a:  Any  character  string  (truncated  to  10  characters) 
or  null  string 

WHAT  SYSTEM  IS  TO  BE  DELETED... 

? 

Response-! c  was  "D".  MADAM  is  prepared  to  delete 
an  alternative.  Entry  of  a  valid  system  causes 
deletion  and  return  of  control  to  prompt-1.  A 
null  string  or  invalid  entry  returns  control  *0 
prompt-1 . 

RESP0NSE-2C:  System  name  or  null  string 

PROMPT- 2c:  ENTER. . .SYSTEM  <nsys>  LABEL 

(10  LETTERS  OR  LESS) 

SITUATION:  Response-1  was  "N".  MADAM  is  ready  to  add  a  new 

system  to  the  alternative  set.  This  prompt  is 
repeated  until  a  null  string  is  entered.  At  that 
time  return  of  control  is  at  prompt-1 . 

RESP0NSE-2c:  Any  character  string  or  null  string 


PR0MPT-2b: 

SITUATION: 
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OPTION:  TTL  (TiTLe) 


USE:  This  option  is  used  to  enter  a  title  for  the  data  structure. 

It  may  be  called  directly.  It  is  invoked  automatically  by 
***NEW***.  There  are  no  cautions  associated  with  this  option. 

PROMPT-1:  ENTER  A  TITLE  FOR  THIS  DATA  STRUCTURE... 

? 

SITUATION:  MADAM  is  ready  to  store  a  descriptive  title  to  be 

used  by  the  ***REV***  and  ***NUM***  options. 

Entering  anything  but  a  null  string  for  the  first 
10  characters  will  result  in  storage  and  the 
question  mark  to  be  repeated.  This  does  not  over¬ 
write  what  was  just  input.  This  allows  entry  of 
more  than  one  one-line  of  information.  Enter  a 
null  string  to  exit  this  option. 

RESPONSE-!:  Any  character  string  or  null  string 
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OPTION:  WVC  (Weights,  Values,  and  Calculate) 

USE:  This  option  is  used  to  enter  the  relative  weights  of  the 
objectives,  or  the  attribute  levels  of  the  alternatives, 
or  to  calculate  the  tree.  It  should  be  used  after  any 
modification  to  the  data  structure. 

****************  Q/\UTI0NS  ************** 

1.  DO  NOT  USE  "C"  BEFORE  USING  OTHER  OPTIONS 

****************  CAUTIONS  ************** 

YOU  MAY  NOW  ENTER  WEIGHTS,  VALUES,  OR  (RE)  CALCUALTE 
THE  TREE.  CHOOSE  YOUR  OPTION. 

W(  EIGHT  V(ALUEC  CALCULATE  E(XIT 

MADAM  is  prepared  to  deal  with  the  numerical  aspects 
of  the  problem.  "E"  returns  control  to  the  main 
option  selection.  Prompts  associated  with  "w"  have 
a  postscript  of  "a".  Prompts  associated  with  "v"  have 
a  postscript  of  "b".  There  are  no  prompts  associated 
with  "c".  Control  automatically  returns  to  the  main 
option  selection  after  using  "c". 

WEIGHTS:  A ( LL  S (ELECT 

? 

The  user  is  asked  whether  or  not  the  whole  hierarchy 
is  to  be  weighted.  "S"  results  in  prompt-2a. 

P.ESPON3E-2a :  "A"  or  "S" 

PR0MPT-2aa :  ENTER  NRN. . .? 

SITUATION:  MADAM  is  asking  for  the  node  which  will  be  the  parent 

of  the  first  span  to  be  weighted. 

RESP0NSE-2aa :  Enter  NRN  followed  by  0  each  digit  followed  by  <cr> 

PROMPT- 3a:  DO  YOU  WISH  TO  ENTER  THE  RELATIVE  WEIGHTS  DIRECTLY, 

(Y/N)  ? 

SITUATION:  The  user  is  being  asked  to  enter  the  relative  weights 

of  a  specified  node  set.  Prompts  associated  with  "Y" 
have  the  postscript  "al" ,  prompts  associated  with  "N" 
have  the  postscript  "a2". 

RESPONSE- 3a:  "Y"  or  "N" 

PROMPT- 2a 1 :  WHAT  IS  THE  WEIGHT  FOR  FACTOR  <n> 

? 

SITUATION:  The  user  is  entering  the  relative  weights  directly. 

The  numbers  entered  should  be  such  that  there  ratios 
of  relative  importances  of  the  factors.  The  inputs 
will  be  normalized  by  MADAM  to  sum  to  100  across  the 
span.  This  prompt  is  repeated  for  all  factors  in  the 
span . 


PROMPT- 1  : 

SITUATION: 


PROMPT- 2 a : 
SITUATION: 
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RESP0N$E-2al : 

PR0MPT-2a2: 

SITUATION: 


RESPONSE-2a2: 

PR0MPT-4a: 

SITUATION: 

RESP0NSE-4a : 
PROMPT- 5a: 
SITUATION: 


RESPONSE-5a 

PR0MPT-2b: 

SITUATION: 


RESpONSE-2b: 

PROMPT-2bb: 

SITUATION: 


A  real  number  followed  by 

ENTER  THE  NUMERATOR  OF  THE  RATIO... 

The  user  is  inputting  weights  through  a  pairwise 
comparison  matrix  between  factors  on  the  span. 
MADAM  computes  the  weights  as  the  normalized 
geometric  mean  vector  across  the  rows  of  the 
pairwise-comparison  matrix.  One  of  the  following 
numbers  should  be  entered  as  the  numerator  or  the 
denominator  (prompt  not  shown)  of  the  ratio.  The 
other  element  of  the  fraction  should  be  1. 


Number 

“1 - 

3 

5 

7 

9 


Meaning 

equally  important 
more  important 
much  more  important 
very  much  more  important 
overwhelmingly  more 
important 


2,4, 6, 8  provide  intermediate  values 
See  Saaty  (1980)  for  a  more  detailed  discussion. 


1  or  digit  between  1  and  9 

ARE  YOU  HAPPY  WITH  THESE  RELATIVE  WEIGHTS?  (Y/N) 

? 

MADAM  is  verifying  the  normalized  relative  weights. 
A  negative  response  returns  control  to  prompt- 3a 
with  the  same  node  set. 


"Y"  or  "N" 


ENTER  COMMENTS  ON  THESE  WEIGHTS... 

? 

The  user  is  invited  to  enter  rationale  about  the 
relative  weights.  This  is  similar  to  the  ***TTL*** 
option  and  these  comments  will  appear  in  ***NUM*** 
output.  Control  is  returned  to  3a  with  a  new  span. 


Any  character  string  or  null  string 

VALUES:  A(LL  S ( ELECT 

? 

MADAM  is  asking  whether  system  attribute  levels  will 
be  entered  for  all  data  nodes.  "S"  results  in  prompt 
2bb. 

"A"  or  "S" 

ENTER  NRN. . .? 

MADAM  is  asking  for  that  node  where  attribute  1 e /el s 
will  be  input.  This  node  should  be  a  data  node. 
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RESP0NSE-2bb :  Enter  NRN  followed  by  0  each  digit  followed  by 

PR0MPT-3b:  WHAT  IS  THE  NEW  LEVEL  (REAL  NUMBER)? 

SITUATION:  MAOAM  is  asking  for  the  attribute  level  of  the 

current  system  for  the  given  attribute.  This 
prompt  is  repeated  for  each  system  at  one  node. 

RESP0NSE-3b:  Real  number 

PROMPT -4b:  ENTER  COMMENTS  ON  THESE  ENTRIES... 

? 

SITUATION:  Similar  to  prompt-5a  but  it  applies  to  the  input 

attribute  levels.  Control  returns  to  prompt-3a 
with  a  new  node. 

RESP0NSE-4b:  Any  character  string  or  null  string 
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